2026-02-20T12:54:00.706 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-20T12:54:00.721 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T12:54:00.807 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756 branch: wip-perezjos-crimson-only-12-02-2026-PR66245 description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced} email: null first_in_suite: false flavor: debug job_id: '60756' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-perezjos-crimson-only-12-02-2026-PR66245 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd target transaction size: 5 seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* sha1: 26bc97655ae0056b78c14ab91d1307332bd6dfca ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: 26bc97655ae0056b78c14ab91d1307332bd6dfca thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 445d5c9ba18a4040e70e25303230c36c77773acb owner: scheduled_jjperez@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 5547 sha1: 26bc97655ae0056b78c14ab91d1307332bd6dfca sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 445d5c9ba18a4040e70e25303230c36c77773acb targets: trial114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJgyGgOnOYczbY0a1a6OyEBNAD214MS9z5OF8DTarvT+H80Rcp4DACC4r2LezvncOhpDIxV+O5JlNRZuRIuAHxo= trial185.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4PjeTapQJzwPJ4pIxg1v4d4QX81B+6d7J0vOqgh947B0+WqtvMMNbLDGVijoHfDCL3c2UC8PUvfQs9Qh6SVXQ= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: ceph_objectstore_tool: false chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 chance_trim_stale_osdmaps: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - rados: balance_reads: true clients: - client.0 objects: 50 op_weights: copy_from: 0 delete: 50 read: 100 rollback: 0 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-20_10:29:19 tube: trial user: jjperez verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T12:54:00.807 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa; will attempt to use it 2026-02-20T12:54:00.807 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks 2026-02-20T12:54:00.807 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T12:54:00.809 INFO:teuthology.task.internal:Checking packages... 2026-02-20T12:54:00.809 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '26bc97655ae0056b78c14ab91d1307332bd6dfca' 2026-02-20T12:54:00.809 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T12:54:00.809 INFO:teuthology.packaging:ref: None 2026-02-20T12:54:00.809 INFO:teuthology.packaging:tag: None 2026-02-20T12:54:00.809 INFO:teuthology.packaging:branch: wip-perezjos-crimson-only-12-02-2026-PR66245 2026-02-20T12:54:00.809 INFO:teuthology.packaging:sha1: 26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T12:54:00.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-perezjos-crimson-only-12-02-2026-PR66245 2026-02-20T12:54:00.924 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5312.g26bc9765 2026-02-20T12:54:00.926 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T12:54:00.937 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T12:54:00.937 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T12:54:00.949 INFO:teuthology.task.internal:Saving configuration 2026-02-20T12:54:00.962 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T12:54:00.974 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T12:54:01.050 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial114.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 12:50:33.025482', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJgyGgOnOYczbY0a1a6OyEBNAD214MS9z5OF8DTarvT+H80Rcp4DACC4r2LezvncOhpDIxV+O5JlNRZuRIuAHxo='} 2026-02-20T12:54:01.105 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial185.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 12:50:33.024882', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4PjeTapQJzwPJ4pIxg1v4d4QX81B+6d7J0vOqgh947B0+WqtvMMNbLDGVijoHfDCL3c2UC8PUvfQs9Qh6SVXQ='} 2026-02-20T12:54:01.105 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T12:54:01.116 INFO:teuthology.task.internal:roles: ubuntu@trial114.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-20T12:54:01.116 INFO:teuthology.task.internal:roles: ubuntu@trial185.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-20T12:54:01.116 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T12:54:01.253 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x741f61e59620>, signals=[15]) 2026-02-20T12:54:01.253 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T12:54:01.264 INFO:teuthology.task.internal:Opening connections... 2026-02-20T12:54:01.264 DEBUG:teuthology.task.internal:connecting to ubuntu@trial114.front.sepia.ceph.com 2026-02-20T12:54:01.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T12:54:01.325 DEBUG:teuthology.task.internal:connecting to ubuntu@trial185.front.sepia.ceph.com 2026-02-20T12:54:01.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T12:54:01.388 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T12:54:01.401 DEBUG:teuthology.orchestra.run.trial114:> uname -m 2026-02-20T12:54:01.417 INFO:teuthology.orchestra.run.trial114.stdout:x86_64 2026-02-20T12:54:01.417 DEBUG:teuthology.orchestra.run.trial114:> cat /etc/os-release 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:NAME="CentOS Stream" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:VERSION="9" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:ID="centos" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:ID_LIKE="rhel fedora" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:VERSION_ID="9" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:PLATFORM_ID="platform:el9" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:ANSI_COLOR="0;31" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:LOGO="fedora-logo-icon" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:HOME_URL="https://centos.org/" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T12:54:01.473 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T12:54:01.474 INFO:teuthology.orchestra.run.trial114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T12:54:01.474 INFO:teuthology.lock.ops:Updating trial114.front.sepia.ceph.com on lock server 2026-02-20T12:54:01.548 DEBUG:teuthology.orchestra.run.trial185:> uname -m 2026-02-20T12:54:01.563 INFO:teuthology.orchestra.run.trial185.stdout:x86_64 2026-02-20T12:54:01.563 DEBUG:teuthology.orchestra.run.trial185:> cat /etc/os-release 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:NAME="CentOS Stream" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:VERSION="9" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:ID="centos" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:ID_LIKE="rhel fedora" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:VERSION_ID="9" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:PLATFORM_ID="platform:el9" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:ANSI_COLOR="0;31" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:LOGO="fedora-logo-icon" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:HOME_URL="https://centos.org/" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T12:54:01.619 INFO:teuthology.orchestra.run.trial185.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T12:54:01.620 INFO:teuthology.orchestra.run.trial185.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T12:54:01.620 INFO:teuthology.lock.ops:Updating trial185.front.sepia.ceph.com on lock server 2026-02-20T12:54:01.706 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T12:54:01.719 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T12:54:01.729 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T12:54:01.729 DEBUG:teuthology.orchestra.run.trial114:> test '!' -e /home/ubuntu/cephtest 2026-02-20T12:54:01.731 DEBUG:teuthology.orchestra.run.trial185:> test '!' -e /home/ubuntu/cephtest 2026-02-20T12:54:01.746 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T12:54:01.758 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T12:54:01.758 DEBUG:teuthology.orchestra.run.trial114:> test -z $(ls -A /var/lib/ceph) 2026-02-20T12:54:01.786 DEBUG:teuthology.orchestra.run.trial185:> test -z $(ls -A /var/lib/ceph) 2026-02-20T12:54:01.804 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T12:54:01.970 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T12:54:01.995 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T12:54:01.995 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T12:54:01.995 DEBUG:teuthology.orchestra.run.trial114:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T12:54:01.995 DEBUG:teuthology.orchestra.run.trial185:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T12:54:02.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:54:02.010 DEBUG:teuthology.orchestra.run.trial185:> uname -r 2026-02-20T12:54:02.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:54:02.010 DEBUG:teuthology.orchestra.run.trial114:> uname -r 2026-02-20T12:54:02.065 INFO:teuthology.orchestra.run.trial185.stdout:5.14.0-681.el9.x86_64 2026-02-20T12:54:02.066 INFO:teuthology.task.kernel:Running kernel on trial185: 5.14.0-681.el9.x86_64 2026-02-20T12:54:02.066 DEBUG:teuthology.orchestra.run.trial185:> sudo yum install -y kernel 2026-02-20T12:54:02.067 INFO:teuthology.orchestra.run.trial114.stdout:5.14.0-681.el9.x86_64 2026-02-20T12:54:02.067 INFO:teuthology.task.kernel:Running kernel on trial114: 5.14.0-681.el9.x86_64 2026-02-20T12:54:02.067 DEBUG:teuthology.orchestra.run.trial114:> sudo yum install -y kernel 2026-02-20T12:54:03.203 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-20T12:54:03.820 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.9 MB 00:01 2026-02-20T12:54:06.691 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 27 MB 00:02 2026-02-20T12:54:08.564 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 27 MB 00:04 2026-02-20T12:54:10.870 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 7.8 MB 00:01 2026-02-20T12:54:12.057 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 20 kB 00:00 2026-02-20T12:54:12.573 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 7.8 MB 00:01 2026-02-20T12:54:12.865 INFO:teuthology.orchestra.run.trial114.stdout:Extra Packages for Enterprise Linux 27 MB/s | 20 MB 00:00 2026-02-20T12:54:13.594 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 20 kB 00:00 2026-02-20T12:54:15.177 INFO:teuthology.orchestra.run.trial185.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-20T12:54:16.117 INFO:teuthology.orchestra.run.trial114.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T12:54:17.123 INFO:teuthology.orchestra.run.trial114.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T12:54:17.123 INFO:teuthology.orchestra.run.trial114.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T12:54:17.142 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T12:54:17.143 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T12:54:17.143 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T12:54:17.168 DEBUG:teuthology.orchestra.run.trial114:> echo no | sudo yum reinstall kernel || true 2026-02-20T12:54:17.468 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 12:54:16 PM UTC. 2026-02-20T12:54:17.548 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T12:54:17.549 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:54:17.549 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-20T12:54:17.549 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:54:17.549 INFO:teuthology.orchestra.run.trial114.stdout:Reinstalling: 2026-02-20T12:54:17.549 INFO:teuthology.orchestra.run.trial114.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T12:54:17.549 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:54:17.549 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T12:54:17.550 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:54:17.550 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:54:17.550 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 803 k 2026-02-20T12:54:17.550 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 0 2026-02-20T12:54:17.550 INFO:teuthology.orchestra.run.trial114.stderr:Operation aborted. 2026-02-20T12:54:17.569 INFO:teuthology.orchestra.run.trial114.stdout:Is this ok [y/N]: 2026-02-20T12:54:17.570 DEBUG:teuthology.orchestra.run.trial114:> sudo yum reinstall -y kernel || true 2026-02-20T12:54:17.870 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 12:54:16 PM UTC. 2026-02-20T12:54:17.949 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T12:54:17.950 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:54:17.950 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-20T12:54:17.950 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:54:17.950 INFO:teuthology.orchestra.run.trial114.stdout:Reinstalling: 2026-02-20T12:54:17.950 INFO:teuthology.orchestra.run.trial114.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T12:54:17.950 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:54:17.950 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T12:54:17.950 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:54:17.950 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:54:17.951 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 803 k 2026-02-20T12:54:17.951 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 0 2026-02-20T12:54:17.951 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T12:54:18.373 INFO:teuthology.orchestra.run.trial185.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T12:54:19.349 INFO:teuthology.orchestra.run.trial114.stdout:kernel-5.14.0-681.el9.x86_64.rpm 601 kB/s | 803 kB 00:01 2026-02-20T12:54:19.350 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:54:19.350 INFO:teuthology.orchestra.run.trial114.stdout:Total 573 kB/s | 803 kB 00:01 2026-02-20T12:54:19.361 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T12:54:19.381 INFO:teuthology.orchestra.run.trial185.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T12:54:19.382 INFO:teuthology.orchestra.run.trial185.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T12:54:19.394 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T12:54:19.394 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T12:54:19.399 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T12:54:19.399 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T12:54:19.400 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T12:54:19.401 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T12:54:19.401 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T12:54:19.422 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T12:54:19.425 DEBUG:teuthology.orchestra.run.trial185:> echo no | sudo yum reinstall kernel || true 2026-02-20T12:54:19.426 INFO:teuthology.orchestra.run.trial114.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T12:54:19.427 INFO:teuthology.orchestra.run.trial114.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T12:54:19.533 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T12:54:19.533 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T12:54:19.589 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T12:54:19.589 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:54:19.590 INFO:teuthology.orchestra.run.trial114.stdout:Reinstalled: 2026-02-20T12:54:19.590 INFO:teuthology.orchestra.run.trial114.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T12:54:19.590 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:54:19.590 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T12:54:19.617 DEBUG:teuthology.orchestra.run.trial114:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T12:54:19.641 INFO:teuthology.orchestra.run.trial114.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T12:54:19.642 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T12:54:19.642 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T12:54:19.643 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T12:54:19.643 DEBUG:teuthology.orchestra.run.trial114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T12:54:19.706 INFO:teuthology.orchestra.run.trial114.stdout:ttyS1 2026-02-20T12:54:19.728 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 12:54:18 PM UTC. 2026-02-20T12:54:19.730 DEBUG:teuthology.parallel:result is None 2026-02-20T12:54:19.809 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T12:54:19.809 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:54:19.810 INFO:teuthology.orchestra.run.trial185.stdout: Package Architecture Version Repository Size 2026-02-20T12:54:19.810 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:54:19.810 INFO:teuthology.orchestra.run.trial185.stdout:Reinstalling: 2026-02-20T12:54:19.810 INFO:teuthology.orchestra.run.trial185.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T12:54:19.810 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:54:19.810 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T12:54:19.810 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:54:19.810 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:54:19.810 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 803 k 2026-02-20T12:54:19.811 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 0 2026-02-20T12:54:19.811 INFO:teuthology.orchestra.run.trial185.stderr:Operation aborted. 2026-02-20T12:54:19.830 INFO:teuthology.orchestra.run.trial185.stdout:Is this ok [y/N]: 2026-02-20T12:54:19.830 DEBUG:teuthology.orchestra.run.trial185:> sudo yum reinstall -y kernel || true 2026-02-20T12:54:20.123 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 12:54:18 PM UTC. 2026-02-20T12:54:20.203 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T12:54:20.203 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout: Package Architecture Version Repository Size 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout:Reinstalling: 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 803 k 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 0 2026-02-20T12:54:20.204 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T12:54:21.275 INFO:teuthology.orchestra.run.trial185.stdout:kernel-5.14.0-681.el9.x86_64.rpm 793 kB/s | 803 kB 00:01 2026-02-20T12:54:21.275 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:54:21.275 INFO:teuthology.orchestra.run.trial185.stdout:Total 749 kB/s | 803 kB 00:01 2026-02-20T12:54:21.285 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T12:54:21.318 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T12:54:21.318 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T12:54:21.322 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T12:54:21.322 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T12:54:21.346 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T12:54:21.350 INFO:teuthology.orchestra.run.trial185.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T12:54:21.350 INFO:teuthology.orchestra.run.trial185.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T12:54:21.455 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T12:54:21.455 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T12:54:21.506 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T12:54:21.506 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:54:21.506 INFO:teuthology.orchestra.run.trial185.stdout:Reinstalled: 2026-02-20T12:54:21.506 INFO:teuthology.orchestra.run.trial185.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T12:54:21.506 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:54:21.506 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T12:54:21.533 DEBUG:teuthology.orchestra.run.trial185:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T12:54:21.556 INFO:teuthology.orchestra.run.trial185.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T12:54:21.557 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T12:54:21.557 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T12:54:21.557 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-20T12:54:21.557 DEBUG:teuthology.orchestra.run.trial185:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T12:54:21.620 INFO:teuthology.orchestra.run.trial185.stdout:ttyS1 2026-02-20T12:54:21.639 DEBUG:teuthology.parallel:result is None 2026-02-20T12:54:21.639 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T12:54:21.650 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T12:54:21.650 DEBUG:teuthology.orchestra.run.trial114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T12:54:21.652 DEBUG:teuthology.orchestra.run.trial185:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T12:54:21.694 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T12:54:21.706 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T12:54:21.719 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T12:54:21.719 DEBUG:teuthology.orchestra.run.trial114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T12:54:21.721 DEBUG:teuthology.orchestra.run.trial185:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T12:54:21.758 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T12:54:21.769 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T12:54:21.769 DEBUG:teuthology.orchestra.run.trial114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T12:54:21.778 DEBUG:teuthology.orchestra.run.trial185:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T12:54:21.799 INFO:teuthology.orchestra.run.trial114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T12:54:21.808 INFO:teuthology.orchestra.run.trial114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T12:54:21.815 INFO:teuthology.orchestra.run.trial185.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T12:54:21.825 INFO:teuthology.orchestra.run.trial185.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T12:54:21.826 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T12:54:21.838 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T12:54:21.838 DEBUG:teuthology.orchestra.run.trial114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T12:54:21.852 DEBUG:teuthology.orchestra.run.trial185:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T12:54:21.890 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T12:54:21.904 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T12:54:21.904 DEBUG:teuthology.orchestra.run.trial114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T12:54:21.916 DEBUG:teuthology.orchestra.run.trial185:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T12:54:21.946 DEBUG:teuthology.orchestra.run.trial114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:54:22.090 DEBUG:teuthology.orchestra.run.trial114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:54:22.113 DEBUG:teuthology.orchestra.run.trial114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:54:22.263 DEBUG:teuthology.orchestra.run.trial114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:54:22.286 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T12:54:22.286 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T12:54:22.349 DEBUG:teuthology.orchestra.run.trial185:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:54:22.468 DEBUG:teuthology.orchestra.run.trial185:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:54:22.493 DEBUG:teuthology.orchestra.run.trial185:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:54:22.616 DEBUG:teuthology.orchestra.run.trial185:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:54:22.639 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T12:54:22.639 DEBUG:teuthology.orchestra.run.trial185:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T12:54:22.702 DEBUG:teuthology.orchestra.run.trial114:> sudo service rsyslog restart 2026-02-20T12:54:22.704 DEBUG:teuthology.orchestra.run.trial185:> sudo service rsyslog restart 2026-02-20T12:54:22.729 INFO:teuthology.orchestra.run.trial114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T12:54:22.770 INFO:teuthology.orchestra.run.trial185.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T12:54:23.267 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T12:54:23.280 INFO:teuthology.task.internal:Starting timer... 2026-02-20T12:54:23.280 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T12:54:23.301 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T12:54:23.319 DEBUG:teuthology.orchestra.run.trial114:> sudo service auditd rotate 2026-02-20T12:54:23.348 INFO:teuthology.orchestra.run.trial114.stdout:Rotating logs: 2026-02-20T12:54:23.350 DEBUG:teuthology.orchestra.run.trial185:> sudo service auditd rotate 2026-02-20T12:54:23.380 INFO:teuthology.orchestra.run.trial185.stdout:Rotating logs: 2026-02-20T12:54:23.388 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T12:54:23.389 DEBUG:teuthology.orchestra.run.trial114:> /usr/sbin/getenforce 2026-02-20T12:54:23.407 INFO:teuthology.orchestra.run.trial114.stdout:Permissive 2026-02-20T12:54:23.407 DEBUG:teuthology.orchestra.run.trial185:> /usr/sbin/getenforce 2026-02-20T12:54:23.453 INFO:teuthology.orchestra.run.trial185.stdout:Permissive 2026-02-20T12:54:23.453 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial114.front.sepia.ceph.com': 'permissive', 'ubuntu@trial185.front.sepia.ceph.com': 'permissive'} 2026-02-20T12:54:23.454 DEBUG:teuthology.orchestra.run.trial114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T12:54:23.482 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:54:23.483 DEBUG:teuthology.orchestra.run.trial185:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T12:54:23.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:54:23.523 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T12:54:23.523 DEBUG:teuthology.orchestra.run.trial114:> sudo /usr/sbin/setenforce permissive 2026-02-20T12:54:23.548 DEBUG:teuthology.orchestra.run.trial185:> sudo /usr/sbin/setenforce permissive 2026-02-20T12:54:23.588 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T12:54:23.602 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T12:54:23.615 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T12:54:23.617 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial114.front.sepia.ceph.com,trial185.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T12:57:26.781 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial114.front.sepia.ceph.com'), Remote(name='ubuntu@trial185.front.sepia.ceph.com')] 2026-02-20T12:57:26.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-20T12:57:26.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T12:57:26.891 DEBUG:teuthology.orchestra.run.trial114:> true 2026-02-20T12:57:26.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial114.front.sepia.ceph.com' 2026-02-20T12:57:26.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-20T12:57:26.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial185.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T12:57:27.071 DEBUG:teuthology.orchestra.run.trial185:> true 2026-02-20T12:57:27.147 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial185.front.sepia.ceph.com' 2026-02-20T12:57:27.147 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T12:57:27.161 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T12:57:27.161 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T12:57:27.162 DEBUG:teuthology.orchestra.run.trial114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:57:27.164 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T12:57:27.164 DEBUG:teuthology.orchestra.run.trial185:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:57:27.191 INFO:teuthology.orchestra.run.trial114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T12:57:27.202 INFO:teuthology.orchestra.run.trial114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T12:57:27.213 INFO:teuthology.orchestra.run.trial185.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T12:57:27.223 INFO:teuthology.orchestra.run.trial114.stderr:sudo: ntpd: command not found 2026-02-20T12:57:27.226 INFO:teuthology.orchestra.run.trial185.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T12:57:27.232 INFO:teuthology.orchestra.run.trial114.stdout:506 Cannot talk to daemon 2026-02-20T12:57:27.244 INFO:teuthology.orchestra.run.trial114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T12:57:27.246 INFO:teuthology.orchestra.run.trial185.stderr:sudo: ntpd: command not found 2026-02-20T12:57:27.255 INFO:teuthology.orchestra.run.trial114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T12:57:27.256 INFO:teuthology.orchestra.run.trial185.stdout:506 Cannot talk to daemon 2026-02-20T12:57:27.268 INFO:teuthology.orchestra.run.trial185.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T12:57:27.281 INFO:teuthology.orchestra.run.trial185.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T12:57:27.311 INFO:teuthology.orchestra.run.trial114.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:57:27.313 INFO:teuthology.orchestra.run.trial114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:57:27.313 INFO:teuthology.orchestra.run.trial114.stdout:=============================================================================== 2026-02-20T12:57:27.331 INFO:teuthology.orchestra.run.trial185.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:57:27.333 INFO:teuthology.orchestra.run.trial185.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:57:27.333 INFO:teuthology.orchestra.run.trial185.stdout:=============================================================================== 2026-02-20T12:57:27.334 INFO:teuthology.run_tasks:Running task install... 2026-02-20T12:57:27.346 DEBUG:teuthology.task.install:project ceph 2026-02-20T12:57:27.346 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}} 2026-02-20T12:57:27.346 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'} 2026-02-20T12:57:27.346 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T12:57:27.349 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T12:57:27.350 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-20T12:57:27.350 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'tag': None, 'wait_for_package': False} 2026-02-20T12:57:27.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T12:57:27.351 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'tag': None, 'wait_for_package': False} 2026-02-20T12:57:27.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T12:57:27.520 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/ 2026-02-20T12:57:27.520 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5312.g26bc9765 2026-02-20T12:57:27.529 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/ 2026-02-20T12:57:27.529 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5312.g26bc9765 2026-02-20T12:57:27.895 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T12:57:27.895 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T12:57:27.895 DEBUG:teuthology.orchestra.run.trial185:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T12:57:27.909 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T12:57:27.909 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T12:57:27.909 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T12:57:27.921 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T12:57:27.921 DEBUG:teuthology.orchestra.run.trial185:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/26bc97655ae0056b78c14ab91d1307332bd6dfca/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T12:57:27.936 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T12:57:27.936 DEBUG:teuthology.orchestra.run.trial114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/26bc97655ae0056b78c14ab91d1307332bd6dfca/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T12:57:27.986 DEBUG:teuthology.orchestra.run.trial185:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T12:57:28.000 DEBUG:teuthology.orchestra.run.trial114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T12:57:28.062 DEBUG:teuthology.orchestra.run.trial185:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T12:57:28.072 DEBUG:teuthology.orchestra.run.trial114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T12:57:28.125 INFO:teuthology.orchestra.run.trial185.stdout:check_obsoletes = 1 2026-02-20T12:57:28.127 DEBUG:teuthology.orchestra.run.trial185:> sudo yum clean all 2026-02-20T12:57:28.136 INFO:teuthology.orchestra.run.trial114.stdout:check_obsoletes = 1 2026-02-20T12:57:28.138 DEBUG:teuthology.orchestra.run.trial114:> sudo yum clean all 2026-02-20T12:57:28.284 INFO:teuthology.orchestra.run.trial185.stdout:41 files removed 2026-02-20T12:57:28.296 INFO:teuthology.orchestra.run.trial114.stdout:41 files removed 2026-02-20T12:57:28.299 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-radosgw 2026-02-20T12:57:28.310 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-radosgw 2026-02-20T12:57:29.077 INFO:teuthology.orchestra.run.trial185.stdout:ceph packages for x86_64 148 kB/s | 94 kB 00:00 2026-02-20T12:57:29.097 INFO:teuthology.orchestra.run.trial114.stdout:ceph packages for x86_64 145 kB/s | 94 kB 00:00 2026-02-20T12:57:29.697 INFO:teuthology.orchestra.run.trial185.stdout:ceph noarch packages 41 kB/s | 24 kB 00:00 2026-02-20T12:57:29.711 INFO:teuthology.orchestra.run.trial114.stdout:ceph noarch packages 42 kB/s | 24 kB 00:00 2026-02-20T12:57:30.252 INFO:teuthology.orchestra.run.trial114.stdout:ceph source packages 4.0 kB/s | 2.1 kB 00:00 2026-02-20T12:57:30.253 INFO:teuthology.orchestra.run.trial185.stdout:ceph source packages 3.9 kB/s | 2.1 kB 00:00 2026-02-20T12:57:31.286 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.9 MB 00:01 2026-02-20T12:57:31.783 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.9 MB 00:01 2026-02-20T12:57:34.637 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 27 MB 00:02 2026-02-20T12:57:35.519 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 27 MB 00:03 2026-02-20T12:57:39.590 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 7.8 MB 00:02 2026-02-20T12:57:40.424 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - Extras packages 187 kB/s | 20 kB 00:00 2026-02-20T12:57:42.116 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 7.8 MB 00:04 2026-02-20T12:57:43.826 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:00 2026-02-20T12:57:46.333 INFO:teuthology.orchestra.run.trial185.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 20 MB 00:05 2026-02-20T12:57:49.532 INFO:teuthology.orchestra.run.trial185.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T12:57:50.728 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T12:57:50.729 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:57:50.729 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repository Size 2026-02-20T12:57:50.729 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:57:50.729 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T12:57:50.729 INFO:teuthology.orchestra.run.trial185.stdout: ceph-radosgw x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 11 M 2026-02-20T12:57:50.729 INFO:teuthology.orchestra.run.trial185.stdout:Upgrading: 2026-02-20T12:57:50.729 INFO:teuthology.orchestra.run.trial185.stdout: librados2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 3.3 M 2026-02-20T12:57:50.729 INFO:teuthology.orchestra.run.trial185.stdout: librbd1 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 2.7 M 2026-02-20T12:57:50.729 INFO:teuthology.orchestra.run.trial185.stdout:Installing dependencies: 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: ceph-base x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 5.1 M 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: ceph-common x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 21 M 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: ceph-selinux x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 25 k 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: libcephfs2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 860 k 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T12:57:50.730 INFO:teuthology.orchestra.run.trial185.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: libradosstriper1 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 263 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: librgw2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 5.6 M 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: python3-ceph-argparse x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 45 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: python3-ceph-common x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 185 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: python3-cephfs x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 203 k 2026-02-20T12:57:50.731 INFO:teuthology.orchestra.run.trial185.stdout: python3-rados x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 324 k 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: python3-rbd x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 305 k 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: python3-rgw x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 100 k 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout:Installing weak dependencies: 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: libcephfs-daemon x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 36 k 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 25 k 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:57:50.732 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T12:57:50.733 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:57:50.733 INFO:teuthology.orchestra.run.trial185.stdout:Install 35 Packages 2026-02-20T12:57:50.733 INFO:teuthology.orchestra.run.trial185.stdout:Upgrade 2 Packages 2026-02-20T12:57:50.733 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:57:50.733 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 61 M 2026-02-20T12:57:50.734 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T12:57:52.899 INFO:teuthology.orchestra.run.trial185.stdout:(1/37): ceph-base-20.3.0-5312.g26bc9765.el9.x86 2.7 MB/s | 5.1 MB 00:01 2026-02-20T12:57:52.964 INFO:teuthology.orchestra.run.trial185.stdout:(2/37): ceph-selinux-20.3.0-5312.g26bc9765.el9. 389 kB/s | 25 kB 00:00 2026-02-20T12:57:53.029 INFO:teuthology.orchestra.run.trial185.stdout:(3/37): libcephfs-daemon-20.3.0-5312.g26bc9765. 559 kB/s | 36 kB 00:00 2026-02-20T12:57:53.094 INFO:teuthology.orchestra.run.trial185.stdout:(4/37): libcephfs-proxy2-20.3.0-5312.g26bc9765. 381 kB/s | 25 kB 00:00 2026-02-20T12:57:53.303 INFO:teuthology.orchestra.run.trial185.stdout:(5/37): libcephfs2-20.3.0-5312.g26bc9765.el9.x8 4.0 MB/s | 860 kB 00:00 2026-02-20T12:57:53.366 INFO:teuthology.orchestra.run.trial185.stdout:(6/37): libradosstriper1-20.3.0-5312.g26bc9765. 4.0 MB/s | 263 kB 00:00 2026-02-20T12:57:54.621 INFO:teuthology.orchestra.run.trial185.stdout:(7/37): librgw2-20.3.0-5312.g26bc9765.el9.x86_6 4.5 MB/s | 5.6 MB 00:01 2026-02-20T12:57:54.686 INFO:teuthology.orchestra.run.trial185.stdout:(8/37): python3-ceph-argparse-20.3.0-5312.g26bc 693 kB/s | 45 kB 00:00 2026-02-20T12:57:54.754 INFO:teuthology.orchestra.run.trial185.stdout:(9/37): python3-ceph-common-20.3.0-5312.g26bc97 2.6 MB/s | 185 kB 00:00 2026-02-20T12:57:54.824 INFO:teuthology.orchestra.run.trial185.stdout:(10/37): python3-cephfs-20.3.0-5312.g26bc9765.e 2.8 MB/s | 203 kB 00:00 2026-02-20T12:57:54.896 INFO:teuthology.orchestra.run.trial185.stdout:(11/37): python3-rados-20.3.0-5312.g26bc9765.el 4.4 MB/s | 324 kB 00:00 2026-02-20T12:57:54.966 INFO:teuthology.orchestra.run.trial185.stdout:(12/37): python3-rbd-20.3.0-5312.g26bc9765.el9. 4.2 MB/s | 305 kB 00:00 2026-02-20T12:57:55.030 INFO:teuthology.orchestra.run.trial185.stdout:(13/37): python3-rgw-20.3.0-5312.g26bc9765.el9. 1.5 MB/s | 100 kB 00:00 2026-02-20T12:57:55.155 INFO:teuthology.orchestra.run.trial185.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 265 kB/s | 33 kB 00:00 2026-02-20T12:57:55.175 INFO:teuthology.orchestra.run.trial185.stdout:(15/37): nvme-cli-2.16-1.el9.x86_64.rpm 58 MB/s | 1.2 MB 00:00 2026-02-20T12:57:55.180 INFO:teuthology.orchestra.run.trial185.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 18 MB/s | 93 kB 00:00 2026-02-20T12:57:55.424 INFO:teuthology.orchestra.run.trial185.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 428 kB/s | 104 kB 00:00 2026-02-20T12:57:55.479 INFO:teuthology.orchestra.run.trial185.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 2.9 MB/s | 164 kB 00:00 2026-02-20T12:57:55.514 INFO:teuthology.orchestra.run.trial185.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.5 MB/s | 160 kB 00:00 2026-02-20T12:57:55.541 INFO:teuthology.orchestra.run.trial185.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.6 MB/s | 45 kB 00:00 2026-02-20T12:57:55.610 INFO:teuthology.orchestra.run.trial185.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 9.4 MB/s | 662 kB 00:00 2026-02-20T12:57:55.641 INFO:teuthology.orchestra.run.trial185.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.4 MB/s | 292 kB 00:00 2026-02-20T12:57:55.670 INFO:teuthology.orchestra.run.trial185.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 8.0 MB/s | 240 kB 00:00 2026-02-20T12:57:55.695 INFO:teuthology.orchestra.run.trial185.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-20T12:57:55.721 INFO:teuthology.orchestra.run.trial185.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-20T12:57:56.078 INFO:teuthology.orchestra.run.trial185.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 863 kB/s | 308 kB 00:00 2026-02-20T12:57:56.169 INFO:teuthology.orchestra.run.trial185.stdout:(27/37): ceph-radosgw-20.3.0-5312.g26bc9765.el9 2.2 MB/s | 11 MB 00:05 2026-02-20T12:57:56.286 INFO:teuthology.orchestra.run.trial185.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 211 kB/s | 25 kB 00:00 2026-02-20T12:57:56.292 INFO:teuthology.orchestra.run.trial185.stdout:(29/37): libarrow-9.0.0-15.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2026-02-20T12:57:56.333 INFO:teuthology.orchestra.run.trial185.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2026-02-20T12:57:56.364 INFO:teuthology.orchestra.run.trial185.stdout:(31/37): liboath-2.6.12-1.el9.x86_64.rpm 624 kB/s | 49 kB 00:00 2026-02-20T12:57:56.378 INFO:teuthology.orchestra.run.trial185.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 18 MB/s | 838 kB 00:00 2026-02-20T12:57:56.424 INFO:teuthology.orchestra.run.trial185.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 34 MB/s | 1.6 MB 00:00 2026-02-20T12:57:56.444 INFO:teuthology.orchestra.run.trial185.stdout:(34/37): re2-20211101-20.el9.x86_64.rpm 2.3 MB/s | 191 kB 00:00 2026-02-20T12:57:57.333 INFO:teuthology.orchestra.run.trial185.stdout:(35/37): librados2-20.3.0-5312.g26bc9765.el9.x8 3.6 MB/s | 3.3 MB 00:00 2026-02-20T12:57:57.707 INFO:teuthology.orchestra.run.trial185.stdout:(36/37): librbd1-20.3.0-5312.g26bc9765.el9.x86_ 2.1 MB/s | 2.7 MB 00:01 2026-02-20T12:58:03.441 INFO:teuthology.orchestra.run.trial185.stdout:(37/37): ceph-common-20.3.0-5312.g26bc9765.el9. 1.7 MB/s | 21 MB 00:12 2026-02-20T12:58:03.443 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:58:03.443 INFO:teuthology.orchestra.run.trial185.stdout:Total 4.8 MB/s | 61 MB 00:12 2026-02-20T12:58:03.539 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T12:58:03.559 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T12:58:03.559 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T12:58:03.811 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T12:58:03.811 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T12:58:04.101 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T12:58:04.241 INFO:teuthology.orchestra.run.trial185.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T12:58:04.245 INFO:teuthology.orchestra.run.trial185.stdout: Upgrading : librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 2/39 2026-02-20T12:58:04.293 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 2/39 2026-02-20T12:58:04.294 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 3/39 2026-02-20T12:58:04.307 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 3/39 2026-02-20T12:58:04.310 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libcephfs-daemon-2:20.3.0-5312.g26bc9765.el9.x86_6 4/39 2026-02-20T12:58:04.311 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_6 5/39 2026-02-20T12:58:04.337 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_6 5/39 2026-02-20T12:58:04.340 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 6/39 2026-02-20T12:58:04.347 INFO:teuthology.orchestra.run.trial185.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T12:58:04.350 INFO:teuthology.orchestra.run.trial185.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T12:58:04.353 INFO:teuthology.orchestra.run.trial185.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T12:58:04.357 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T12:58:04.368 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-ceph-argparse-2:20.3.0-5312.g26bc9765.el9. 11/39 2026-02-20T12:58:04.381 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 12/39 2026-02-20T12:58:04.382 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_6 13/39 2026-02-20T12:58:04.406 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_6 13/39 2026-02-20T12:58:04.411 INFO:teuthology.orchestra.run.trial185.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T12:58:04.443 INFO:teuthology.orchestra.run.trial185.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T12:58:04.447 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T12:58:04.453 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T12:58:04.455 INFO:teuthology.orchestra.run.trial185.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T12:58:04.460 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T12:58:04.575 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T12:58:04.576 INFO:teuthology.orchestra.run.trial185.stdout: Upgrading : librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 21/39 2026-02-20T12:58:04.602 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 21/39 2026-02-20T12:58:04.605 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 22/39 2026-02-20T12:58:04.613 INFO:teuthology.orchestra.run.trial185.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T12:58:04.861 INFO:teuthology.orchestra.run.trial185.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T12:58:04.862 INFO:teuthology.orchestra.run.trial185.stdout: Installing : librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 25/39 2026-02-20T12:58:04.879 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 25/39 2026-02-20T12:58:04.884 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 26/39 2026-02-20T12:58:04.889 INFO:teuthology.orchestra.run.trial185.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T12:58:04.892 INFO:teuthology.orchestra.run.trial185.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T12:58:04.892 INFO:teuthology.orchestra.run.trial185.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T12:58:04.911 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T12:58:05.027 INFO:teuthology.orchestra.run.trial185.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T12:58:05.030 INFO:teuthology.orchestra.run.trial185.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T12:58:05.311 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T12:58:05.311 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T12:58:05.311 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:58:05.357 INFO:teuthology.orchestra.run.trial185.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T12:58:05.359 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-ceph-common-2:20.3.0-5312.g26bc9765.el9.x8 33/39 2026-02-20T12:58:06.300 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 34/39 2026-02-20T12:58:06.303 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 34/39 2026-02-20T12:58:06.565 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 34/39 2026-02-20T12:58:06.568 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 35/39 2026-02-20T12:58:06.607 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 35/39 2026-02-20T12:58:06.607 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T12:58:06.607 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T12:58:06.607 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:58:06.611 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 36/39 2026-02-20T12:58:11.183 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 36/39 2026-02-20T12:58:11.184 INFO:teuthology.orchestra.run.trial185.stdout:skipping the directory /sys 2026-02-20T12:58:11.184 INFO:teuthology.orchestra.run.trial185.stdout:skipping the directory /proc 2026-02-20T12:58:11.184 INFO:teuthology.orchestra.run.trial185.stdout:skipping the directory /mnt 2026-02-20T12:58:11.184 INFO:teuthology.orchestra.run.trial185.stdout:skipping the directory /var/tmp 2026-02-20T12:58:11.184 INFO:teuthology.orchestra.run.trial185.stdout:skipping the directory /home 2026-02-20T12:58:11.184 INFO:teuthology.orchestra.run.trial185.stdout:skipping the directory /root 2026-02-20T12:58:11.184 INFO:teuthology.orchestra.run.trial185.stdout:skipping the directory /tmp 2026-02-20T12:58:11.184 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:58:11.674 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 37/39 2026-02-20T12:58:11.697 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 37/39 2026-02-20T12:58:11.697 INFO:teuthology.orchestra.run.trial185.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:58:11.697 INFO:teuthology.orchestra.run.trial185.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T12:58:11.697 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T12:58:11.697 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T12:58:11.697 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:58:11.699 INFO:teuthology.orchestra.run.trial185.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T12:58:11.711 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T12:58:11.711 INFO:teuthology.orchestra.run.trial185.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T12:58:11.767 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T12:58:11.767 INFO:teuthology.orchestra.run.trial185.stdout:Creating group 'qat' with GID 992. 2026-02-20T12:58:11.767 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:58:12.064 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 1/39 2026-02-20T12:58:12.064 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 2/39 2026-02-20T12:58:12.064 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 3/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 4/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libcephfs-daemon-2:20.3.0-5312.g26bc9765.el9.x86_6 5/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_6 6/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 7/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_6 8/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 9/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5312.g26bc9765.el9. 10/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-ceph-common-2:20.3.0-5312.g26bc9765.el9.x8 11/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 12/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 13/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 14/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 15/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T12:58:12.065 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T12:58:12.066 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T12:58:12.066 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T12:58:12.066 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T12:58:12.066 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T12:58:12.066 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 36/39 2026-02-20T12:58:12.066 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T12:58:12.066 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 38/39 2026-02-20T12:58:12.127 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T12:58:12.127 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:58:12.127 INFO:teuthology.orchestra.run.trial185.stdout:Upgraded: 2026-02-20T12:58:12.127 INFO:teuthology.orchestra.run.trial185.stdout: librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: libcephfs-daemon-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: python3-ceph-argparse-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.128 INFO:teuthology.orchestra.run.trial185.stdout: python3-ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:58:12.129 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T12:58:12.168 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-test 2026-02-20T12:58:12.476 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:23 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T12:58:12.559 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repository Size 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: ceph-test x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 125 M 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout:Installing dependencies: 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: libcephsqlite x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 153 k 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T12:58:12.560 INFO:teuthology.orchestra.run.trial185.stdout:Install 12 Packages 2026-02-20T12:58:12.561 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:58:12.561 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 129 M 2026-02-20T12:58:12.561 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 963 M 2026-02-20T12:58:12.561 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T12:58:13.311 INFO:teuthology.orchestra.run.trial185.stdout:(1/12): libcephsqlite-20.3.0-5312.g26bc9765.el9 310 kB/s | 153 kB 00:00 2026-02-20T12:58:13.715 INFO:teuthology.orchestra.run.trial185.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 57 kB/s | 23 kB 00:00 2026-02-20T12:58:13.955 INFO:teuthology.orchestra.run.trial185.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 392 kB/s | 94 kB 00:00 2026-02-20T12:58:13.980 INFO:teuthology.orchestra.run.trial185.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 20 MB/s | 525 kB 00:00 2026-02-20T12:58:13.986 INFO:teuthology.orchestra.run.trial185.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 28 MB/s | 176 kB 00:00 2026-02-20T12:58:13.992 INFO:teuthology.orchestra.run.trial185.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 37 MB/s | 233 kB 00:00 2026-02-20T12:58:14.018 INFO:teuthology.orchestra.run.trial185.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 39 MB/s | 1.0 MB 00:00 2026-02-20T12:58:14.025 INFO:teuthology.orchestra.run.trial185.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 47 MB/s | 303 kB 00:00 2026-02-20T12:58:14.029 INFO:teuthology.orchestra.run.trial185.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 14 MB/s | 64 kB 00:00 2026-02-20T12:58:14.145 INFO:teuthology.orchestra.run.trial185.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.0 MB/s | 122 kB 00:00 2026-02-20T12:58:16.630 INFO:teuthology.orchestra.run.trial185.stdout:(11/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 563 kB/s | 2.1 MB 00:03 2026-02-20T12:58:25.206 INFO:teuthology.orchestra.run.trial114.stdout:Extra Packages for Enterprise Linux 503 kB/s | 20 MB 00:41 2026-02-20T12:58:35.851 INFO:teuthology.orchestra.run.trial114.stdout:lab-extras 6.7 kB/s | 50 kB 00:07 2026-02-20T12:58:37.047 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T12:58:37.048 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout: ceph-radosgw x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 11 M 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout:Upgrading: 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout: librados2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 3.3 M 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout: librbd1 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 2.7 M 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout: ceph-base x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 5.1 M 2026-02-20T12:58:37.049 INFO:teuthology.orchestra.run.trial114.stdout: ceph-common x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 21 M 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: ceph-selinux x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 25 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 860 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: libradosstriper1 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 263 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T12:58:37.050 INFO:teuthology.orchestra.run.trial114.stdout: librgw2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 5.6 M 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-argparse x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 45 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-common x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 185 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: python3-cephfs x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 203 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: python3-rados x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 324 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: python3-rbd x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 305 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: python3-rgw x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 100 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T12:58:37.051 INFO:teuthology.orchestra.run.trial114.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout:Installing weak dependencies: 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-daemon x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 36 k 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 25 k 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout:Install 35 Packages 2026-02-20T12:58:37.052 INFO:teuthology.orchestra.run.trial114.stdout:Upgrade 2 Packages 2026-02-20T12:58:37.053 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:58:37.053 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 61 M 2026-02-20T12:58:37.053 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T12:58:42.392 INFO:teuthology.orchestra.run.trial114.stdout:(1/37): ceph-base-20.3.0-5312.g26bc9765.el9.x86 1.3 MB/s | 5.1 MB 00:03 2026-02-20T12:58:42.461 INFO:teuthology.orchestra.run.trial114.stdout:(2/37): ceph-selinux-20.3.0-5312.g26bc9765.el9. 363 kB/s | 25 kB 00:00 2026-02-20T12:58:42.530 INFO:teuthology.orchestra.run.trial114.stdout:(3/37): libcephfs-daemon-20.3.0-5312.g26bc9765. 524 kB/s | 36 kB 00:00 2026-02-20T12:58:42.601 INFO:teuthology.orchestra.run.trial114.stdout:(4/37): libcephfs-proxy2-20.3.0-5312.g26bc9765. 352 kB/s | 25 kB 00:00 2026-02-20T12:58:43.332 INFO:teuthology.orchestra.run.trial114.stdout:(5/37): libcephfs2-20.3.0-5312.g26bc9765.el9.x8 1.1 MB/s | 860 kB 00:00 2026-02-20T12:58:43.590 INFO:teuthology.orchestra.run.trial114.stdout:(6/37): libradosstriper1-20.3.0-5312.g26bc9765. 1.0 MB/s | 263 kB 00:00 2026-02-20T12:58:43.734 INFO:teuthology.orchestra.run.trial114.stdout:(7/37): ceph-radosgw-20.3.0-5312.g26bc9765.el9. 2.2 MB/s | 11 MB 00:05 2026-02-20T12:58:43.801 INFO:teuthology.orchestra.run.trial114.stdout:(8/37): python3-ceph-argparse-20.3.0-5312.g26bc 674 kB/s | 45 kB 00:00 2026-02-20T12:58:43.839 INFO:teuthology.orchestra.run.trial114.stdout:(9/37): ceph-common-20.3.0-5312.g26bc9765.el9.x 3.9 MB/s | 21 MB 00:05 2026-02-20T12:58:43.908 INFO:teuthology.orchestra.run.trial114.stdout:(10/37): python3-cephfs-20.3.0-5312.g26bc9765.e 2.9 MB/s | 203 kB 00:00 2026-02-20T12:58:43.928 INFO:teuthology.orchestra.run.trial114.stdout:(11/37): python3-ceph-common-20.3.0-5312.g26bc9 1.4 MB/s | 185 kB 00:00 2026-02-20T12:58:44.038 INFO:teuthology.orchestra.run.trial114.stdout:(12/37): python3-rados-20.3.0-5312.g26bc9765.el 2.4 MB/s | 324 kB 00:00 2026-02-20T12:58:44.064 INFO:teuthology.orchestra.run.trial114.stdout:(13/37): python3-rbd-20.3.0-5312.g26bc9765.el9. 2.2 MB/s | 305 kB 00:00 2026-02-20T12:58:44.091 INFO:teuthology.orchestra.run.trial114.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 1.2 MB/s | 33 kB 00:00 2026-02-20T12:58:44.105 INFO:teuthology.orchestra.run.trial114.stdout:(15/37): python3-rgw-20.3.0-5312.g26bc9765.el9. 1.5 MB/s | 100 kB 00:00 2026-02-20T12:58:44.138 INFO:teuthology.orchestra.run.trial114.stdout:(16/37): nvme-cli-2.16-1.el9.x86_64.rpm 24 MB/s | 1.2 MB 00:00 2026-02-20T12:58:44.139 INFO:teuthology.orchestra.run.trial114.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 2.7 MB/s | 93 kB 00:00 2026-02-20T12:58:44.971 INFO:teuthology.orchestra.run.trial114.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 125 kB/s | 104 kB 00:00 2026-02-20T12:58:45.057 INFO:teuthology.orchestra.run.trial114.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 179 kB/s | 164 kB 00:00 2026-02-20T12:58:45.142 INFO:teuthology.orchestra.run.trial114.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 535 kB/s | 45 kB 00:00 2026-02-20T12:58:45.210 INFO:teuthology.orchestra.run.trial114.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 671 kB/s | 160 kB 00:00 2026-02-20T12:58:45.610 INFO:teuthology.orchestra.run.trial114.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 731 kB/s | 292 kB 00:00 2026-02-20T12:58:45.929 INFO:teuthology.orchestra.run.trial114.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 752 kB/s | 240 kB 00:00 2026-02-20T12:58:45.933 INFO:teuthology.orchestra.run.trial114.stdout:(24/37): librdkafka-1.6.1-102.el9.x86_64.rpm 837 kB/s | 662 kB 00:00 2026-02-20T12:58:46.014 INFO:teuthology.orchestra.run.trial114.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 435 kB/s | 37 kB 00:00 2026-02-20T12:58:46.015 INFO:teuthology.orchestra.run.trial114.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 804 kB/s | 66 kB 00:00 2026-02-20T12:58:47.222 INFO:teuthology.orchestra.run.trial114.stdout:(27/37): librgw2-20.3.0-5312.g26bc9765.el9.x86_ 1.6 MB/s | 5.6 MB 00:03 2026-02-20T12:58:51.207 INFO:teuthology.orchestra.run.trial114.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 6.2 kB/s | 25 kB 00:03 2026-02-20T12:58:51.266 INFO:teuthology.orchestra.run.trial114.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 871 kB/s | 49 kB 00:00 2026-02-20T12:58:51.292 INFO:teuthology.orchestra.run.trial114.stdout:(30/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 58 kB/s | 308 kB 00:05 2026-02-20T12:58:51.295 INFO:teuthology.orchestra.run.trial114.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 2.2 MB/s | 67 kB 00:00 2026-02-20T12:58:51.352 INFO:teuthology.orchestra.run.trial114.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 14 MB/s | 838 kB 00:00 2026-02-20T12:58:51.353 INFO:teuthology.orchestra.run.trial114.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 3.3 MB/s | 191 kB 00:00 2026-02-20T12:58:51.461 INFO:teuthology.orchestra.run.trial114.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 830 kB/s | 4.4 MB 00:05 2026-02-20T12:58:51.466 INFO:teuthology.orchestra.run.trial114.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2026-02-20T12:58:52.464 INFO:teuthology.orchestra.run.trial114.stdout:(36/37): librbd1-20.3.0-5312.g26bc9765.el9.x86_ 2.7 MB/s | 2.7 MB 00:01 2026-02-20T12:58:54.133 INFO:teuthology.orchestra.run.trial114.stdout:(37/37): librados2-20.3.0-5312.g26bc9765.el9.x8 1.2 MB/s | 3.3 MB 00:02 2026-02-20T12:58:54.135 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:58:54.135 INFO:teuthology.orchestra.run.trial114.stdout:Total 3.6 MB/s | 61 MB 00:17 2026-02-20T12:58:54.230 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T12:58:54.248 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T12:58:54.248 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T12:58:54.499 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T12:58:54.499 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T12:58:54.787 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T12:58:54.928 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T12:58:54.933 INFO:teuthology.orchestra.run.trial114.stdout: Upgrading : librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 2/39 2026-02-20T12:58:54.980 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 2/39 2026-02-20T12:58:54.981 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 3/39 2026-02-20T12:58:54.992 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 3/39 2026-02-20T12:58:54.994 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs-daemon-2:20.3.0-5312.g26bc9765.el9.x86_6 4/39 2026-02-20T12:58:54.995 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_6 5/39 2026-02-20T12:58:55.022 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_6 5/39 2026-02-20T12:58:55.025 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 6/39 2026-02-20T12:58:55.033 INFO:teuthology.orchestra.run.trial114.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T12:58:55.038 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T12:58:55.041 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T12:58:55.045 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T12:58:55.056 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-ceph-argparse-2:20.3.0-5312.g26bc9765.el9. 11/39 2026-02-20T12:58:55.069 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 12/39 2026-02-20T12:58:55.069 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_6 13/39 2026-02-20T12:58:55.091 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_6 13/39 2026-02-20T12:58:55.095 INFO:teuthology.orchestra.run.trial114.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T12:58:55.124 INFO:teuthology.orchestra.run.trial114.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T12:58:55.130 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T12:58:55.138 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T12:58:55.140 INFO:teuthology.orchestra.run.trial114.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T12:58:55.145 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T12:58:55.258 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T12:58:55.259 INFO:teuthology.orchestra.run.trial114.stdout: Upgrading : librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 21/39 2026-02-20T12:58:55.288 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 21/39 2026-02-20T12:58:55.290 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 22/39 2026-02-20T12:58:55.296 INFO:teuthology.orchestra.run.trial114.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T12:58:55.544 INFO:teuthology.orchestra.run.trial114.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T12:58:55.545 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 25/39 2026-02-20T12:58:55.563 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 25/39 2026-02-20T12:58:55.569 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 26/39 2026-02-20T12:58:55.575 INFO:teuthology.orchestra.run.trial114.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T12:58:55.577 INFO:teuthology.orchestra.run.trial114.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T12:58:55.578 INFO:teuthology.orchestra.run.trial114.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T12:58:55.597 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T12:58:55.713 INFO:teuthology.orchestra.run.trial114.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T12:58:55.715 INFO:teuthology.orchestra.run.trial114.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T12:58:55.987 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T12:58:55.988 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T12:58:55.988 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:58:56.031 INFO:teuthology.orchestra.run.trial114.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T12:58:56.033 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-ceph-common-2:20.3.0-5312.g26bc9765.el9.x8 33/39 2026-02-20T12:58:56.977 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 34/39 2026-02-20T12:58:56.980 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 34/39 2026-02-20T12:58:57.245 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 34/39 2026-02-20T12:58:57.248 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 35/39 2026-02-20T12:58:57.288 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 35/39 2026-02-20T12:58:57.288 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T12:58:57.288 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T12:58:57.289 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:58:57.292 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 36/39 2026-02-20T12:59:01.727 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 36/39 2026-02-20T12:59:01.727 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /sys 2026-02-20T12:59:01.727 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /proc 2026-02-20T12:59:01.727 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /mnt 2026-02-20T12:59:01.727 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /var/tmp 2026-02-20T12:59:01.727 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /home 2026-02-20T12:59:01.727 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /root 2026-02-20T12:59:01.727 INFO:teuthology.orchestra.run.trial114.stdout:skipping the directory /tmp 2026-02-20T12:59:01.728 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:59:02.091 INFO:teuthology.orchestra.run.trial185.stdout:(12/12): ceph-test-20.3.0-5312.g26bc9765.el9.x8 2.5 MB/s | 125 MB 00:49 2026-02-20T12:59:02.093 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T12:59:02.094 INFO:teuthology.orchestra.run.trial185.stdout:Total 2.6 MB/s | 129 MB 00:49 2026-02-20T12:59:02.167 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T12:59:02.179 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T12:59:02.179 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T12:59:02.223 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 37/39 2026-02-20T12:59:02.247 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 37/39 2026-02-20T12:59:02.248 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T12:59:02.248 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T12:59:02.248 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T12:59:02.248 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T12:59:02.248 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:59:02.249 INFO:teuthology.orchestra.run.trial114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T12:59:02.262 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T12:59:02.262 INFO:teuthology.orchestra.run.trial114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T12:59:02.319 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T12:59:02.319 INFO:teuthology.orchestra.run.trial114.stdout:Creating group 'qat' with GID 992. 2026-02-20T12:59:02.319 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:59:02.602 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T12:59:02.602 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T12:59:02.623 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 1/39 2026-02-20T12:59:02.623 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 2/39 2026-02-20T12:59:02.623 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 3/39 2026-02-20T12:59:02.623 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 4/39 2026-02-20T12:59:02.623 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs-daemon-2:20.3.0-5312.g26bc9765.el9.x86_6 5/39 2026-02-20T12:59:02.623 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_6 6/39 2026-02-20T12:59:02.623 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 7/39 2026-02-20T12:59:02.623 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_6 8/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 9/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5312.g26bc9765.el9. 10/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-ceph-common-2:20.3.0-5312.g26bc9765.el9.x8 11/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 12/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 13/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 14/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 15/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T12:59:02.624 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T12:59:02.625 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T12:59:02.626 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T12:59:02.626 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T12:59:02.626 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 36/39 2026-02-20T12:59:02.626 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T12:59:02.626 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 38/39 2026-02-20T12:59:02.684 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T12:59:02.684 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:59:02.684 INFO:teuthology.orchestra.run.trial114.stdout:Upgraded: 2026-02-20T12:59:02.684 INFO:teuthology.orchestra.run.trial114.stdout: librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: ceph-selinux-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-daemon-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.685 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-proxy2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: libradosstriper1-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: librgw2-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T12:59:02.686 INFO:teuthology.orchestra.run.trial114.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-argparse-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: python3-ceph-common-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T12:59:02.687 INFO:teuthology.orchestra.run.trial114.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T12:59:02.688 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:59:02.688 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T12:59:02.726 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-test 2026-02-20T12:59:03.039 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:28 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T12:59:03.050 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T12:59:03.059 INFO:teuthology.orchestra.run.trial185.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T12:59:03.067 INFO:teuthology.orchestra.run.trial185.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T12:59:03.072 INFO:teuthology.orchestra.run.trial185.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T12:59:03.076 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T12:59:03.079 INFO:teuthology.orchestra.run.trial185.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T12:59:03.083 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T12:59:03.084 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T12:59:03.100 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T12:59:03.102 INFO:teuthology.orchestra.run.trial185.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T12:59:03.111 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T12:59:03.120 INFO:teuthology.orchestra.run.trial185.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T12:59:03.120 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 11/12 2026-02-20T12:59:03.122 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T12:59:03.123 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:59:03.123 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-20T12:59:03.123 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: ceph-test x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 125 M 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: libcephsqlite x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 153 k 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T12:59:03.124 INFO:teuthology.orchestra.run.trial114.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T12:59:03.125 INFO:teuthology.orchestra.run.trial114.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T12:59:03.125 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:59:03.125 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T12:59:03.125 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T12:59:03.125 INFO:teuthology.orchestra.run.trial114.stdout:Install 12 Packages 2026-02-20T12:59:03.125 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T12:59:03.126 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 129 M 2026-02-20T12:59:03.126 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 963 M 2026-02-20T12:59:03.126 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T12:59:10.022 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 11/12 2026-02-20T12:59:10.040 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 12/12 2026-02-20T12:59:10.817 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 12/12 2026-02-20T12:59:10.817 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 1/12 2026-02-20T12:59:10.817 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 2/12 2026-02-20T12:59:10.817 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T12:59:10.817 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T12:59:10.817 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T12:59:10.817 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T12:59:10.818 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T12:59:10.818 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T12:59:10.818 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T12:59:10.818 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T12:59:10.818 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T12:59:10.872 INFO:teuthology.orchestra.run.trial185.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T12:59:10.873 INFO:teuthology.orchestra.run.trial185.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T12:59:10.873 INFO:teuthology.orchestra.run.trial185.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T12:59:10.873 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:59:10.873 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T12:59:10.914 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph 2026-02-20T12:59:11.223 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:01:22 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T12:59:11.305 INFO:teuthology.orchestra.run.trial114.stdout:(1/12): libcephsqlite-20.3.0-5312.g26bc9765.el9 272 kB/s | 153 kB 00:00 2026-02-20T12:59:11.311 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T12:59:11.313 INFO:teuthology.orchestra.run.trial185.stdout:======================================================================================= 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repository Size 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout:======================================================================================= 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 6.5 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout:Installing dependencies: 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 57 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mds x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 2.0 M 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 937 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 297 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mon x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 4.9 M 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph-osd x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 163 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph-osd-classic x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 15 M 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph-osd-crimson x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 85 M 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 17 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: cephadm noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 1.0 M 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T12:59:11.314 INFO:teuthology.orchestra.run.trial185.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T12:59:11.315 INFO:teuthology.orchestra.run.trial185.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T12:59:11.316 INFO:teuthology.orchestra.run.trial185.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout:Installing weak dependencies: 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 184 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 51 M 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 7.4 M 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 22 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-rook noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 50 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: ceph-volume noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 299 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout:======================================================================================= 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout:Install 96 Packages 2026-02-20T12:59:11.317 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T12:59:11.318 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 223 M 2026-02-20T12:59:11.318 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 1.5 G 2026-02-20T12:59:11.318 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T12:59:12.120 INFO:teuthology.orchestra.run.trial185.stdout:(1/96): ceph-20.3.0-5312.g26bc9765.el9.x86_64.r 23 kB/s | 6.5 kB 00:00 2026-02-20T12:59:12.636 INFO:teuthology.orchestra.run.trial185.stdout:(2/96): ceph-mgr-20.3.0-5312.g26bc9765.el9.x86_ 1.1 MB/s | 937 kB 00:00 2026-02-20T12:59:12.706 INFO:teuthology.orchestra.run.trial185.stdout:(3/96): ceph-osd-20.3.0-5312.g26bc9765.el9.x86_ 2.3 MB/s | 163 kB 00:00 2026-02-20T12:59:13.003 INFO:teuthology.orchestra.run.trial185.stdout:(4/96): ceph-mds-20.3.0-5312.g26bc9765.el9.x86_ 1.7 MB/s | 2.0 MB 00:01 2026-02-20T12:59:15.325 INFO:teuthology.orchestra.run.trial185.stdout:(5/96): ceph-mon-20.3.0-5312.g26bc9765.el9.x86_ 1.5 MB/s | 4.9 MB 00:03 2026-02-20T12:59:15.397 INFO:teuthology.orchestra.run.trial185.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5312.g26 797 kB/s | 57 kB 00:00 2026-02-20T12:59:15.527 INFO:teuthology.orchestra.run.trial185.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5312.g26bc9765. 1.4 MB/s | 184 kB 00:00 2026-02-20T12:59:18.910 INFO:teuthology.orchestra.run.trial185.stdout:(8/96): ceph-osd-classic-20.3.0-5312.g26bc9765. 2.4 MB/s | 15 MB 00:06 2026-02-20T12:59:21.037 INFO:teuthology.orchestra.run.trial114.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 2.3 kB/s | 23 kB 00:09 2026-02-20T12:59:21.061 INFO:teuthology.orchestra.run.trial114.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 3.8 MB/s | 94 kB 00:00 2026-02-20T12:59:21.098 INFO:teuthology.orchestra.run.trial114.stdout:(4/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 207 kB/s | 2.1 MB 00:10 2026-02-20T12:59:22.631 INFO:teuthology.orchestra.run.trial185.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 2.0 MB/s | 7.4 MB 00:03 2026-02-20T12:59:22.690 INFO:teuthology.orchestra.run.trial185.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5312.g26bc97 376 kB/s | 22 kB 00:00 2026-02-20T12:59:22.877 INFO:teuthology.orchestra.run.trial185.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5312.g26b 1.6 MB/s | 297 kB 00:00 2026-02-20T12:59:22.928 INFO:teuthology.orchestra.run.trial114.stdout:(5/12): libasan8-15.2.1-7.el9.x86_64.rpm 281 kB/s | 525 kB 00:01 2026-02-20T12:59:22.939 INFO:teuthology.orchestra.run.trial185.stdout:(12/96): ceph-mgr-rook-20.3.0-5312.g26bc9765.el 816 kB/s | 50 kB 00:00 2026-02-20T12:59:22.999 INFO:teuthology.orchestra.run.trial185.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5312.g26 290 kB/s | 17 kB 00:00 2026-02-20T12:59:23.073 INFO:teuthology.orchestra.run.trial114.stdout:(6/12): libubsan-11.5.0-14.el9.x86_64.rpm 89 kB/s | 176 kB 00:01 2026-02-20T12:59:23.192 INFO:teuthology.orchestra.run.trial185.stdout:(14/96): ceph-volume-20.3.0-5312.g26bc9765.el9. 1.5 MB/s | 299 kB 00:00 2026-02-20T12:59:23.708 INFO:teuthology.orchestra.run.trial114.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 299 kB/s | 233 kB 00:00 2026-02-20T12:59:23.801 INFO:teuthology.orchestra.run.trial185.stdout:(15/96): cephadm-20.3.0-5312.g26bc9765.el9.noar 1.7 MB/s | 1.0 MB 00:00 2026-02-20T12:59:23.971 INFO:teuthology.orchestra.run.trial185.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 2.0 MB/s | 351 kB 00:00 2026-02-20T12:59:23.979 INFO:teuthology.orchestra.run.trial185.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.6 MB/s | 40 kB 00:00 2026-02-20T12:59:23.988 INFO:teuthology.orchestra.run.trial185.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 8.0 MB/s | 72 kB 00:00 2026-02-20T12:59:24.008 INFO:teuthology.orchestra.run.trial185.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 40 MB/s | 794 kB 00:00 2026-02-20T12:59:24.019 INFO:teuthology.orchestra.run.trial185.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 16 MB/s | 184 kB 00:00 2026-02-20T12:59:24.030 INFO:teuthology.orchestra.run.trial185.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 22 MB/s | 253 kB 00:00 2026-02-20T12:59:24.063 INFO:teuthology.orchestra.run.trial185.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 38 MB/s | 1.2 MB 00:00 2026-02-20T12:59:24.073 INFO:teuthology.orchestra.run.trial185.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 10 MB/s | 106 kB 00:00 2026-02-20T12:59:24.084 INFO:teuthology.orchestra.run.trial185.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 13 MB/s | 135 kB 00:00 2026-02-20T12:59:24.095 INFO:teuthology.orchestra.run.trial185.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 14 MB/s | 150 kB 00:00 2026-02-20T12:59:24.105 INFO:teuthology.orchestra.run.trial185.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 12 MB/s | 126 kB 00:00 2026-02-20T12:59:24.116 INFO:teuthology.orchestra.run.trial185.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 20 MB/s | 218 kB 00:00 2026-02-20T12:59:24.128 INFO:teuthology.orchestra.run.trial185.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-20T12:59:24.138 INFO:teuthology.orchestra.run.trial185.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 25 MB/s | 266 kB 00:00 2026-02-20T12:59:24.891 INFO:teuthology.orchestra.run.trial185.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 39 kB/s | 30 kB 00:00 2026-02-20T12:59:25.867 INFO:teuthology.orchestra.run.trial114.stdout:(8/12): protobuf-3.14.0-17.el9.x86_64.rpm 368 kB/s | 1.0 MB 00:02 2026-02-20T12:59:26.484 INFO:teuthology.orchestra.run.trial114.stdout:(9/12): socat-1.7.4.1-8.el9.x86_64.rpm 109 kB/s | 303 kB 00:02 2026-02-20T12:59:26.487 INFO:teuthology.orchestra.run.trial114.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2026-02-20T12:59:26.760 INFO:teuthology.orchestra.run.trial114.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 442 kB/s | 122 kB 00:00 2026-02-20T12:59:28.340 INFO:teuthology.orchestra.run.trial185.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 887 kB/s | 3.0 MB 00:03 2026-02-20T12:59:28.438 INFO:teuthology.orchestra.run.trial185.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 151 kB/s | 15 kB 00:00 2026-02-20T12:59:28.771 INFO:teuthology.orchestra.run.trial185.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 742 kB/s | 246 kB 00:00 2026-02-20T12:59:29.026 INFO:teuthology.orchestra.run.trial185.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 739 kB/s | 188 kB 00:00 2026-02-20T12:59:29.125 INFO:teuthology.orchestra.run.trial185.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 425 kB/s | 42 kB 00:00 2026-02-20T12:59:35.144 INFO:teuthology.orchestra.run.trial185.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 899 kB/s | 5.3 MB 00:06 2026-02-20T12:59:38.689 INFO:teuthology.orchestra.run.trial185.stdout:(37/96): ceph-mgr-dashboard-20.3.0-5312.g26bc97 2.2 MB/s | 51 MB 00:23 2026-02-20T12:59:39.417 INFO:teuthology.orchestra.run.trial185.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 336 kB/s | 244 kB 00:00 2026-02-20T12:59:39.749 INFO:teuthology.orchestra.run.trial185.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 749 kB/s | 249 kB 00:00 2026-02-20T12:59:39.847 INFO:teuthology.orchestra.run.trial185.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 483 kB/s | 48 kB 00:00 2026-02-20T12:59:40.101 INFO:teuthology.orchestra.run.trial185.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 696 kB/s | 177 kB 00:00 2026-02-20T12:59:41.534 INFO:teuthology.orchestra.run.trial185.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 874 kB/s | 1.2 MB 00:01 2026-02-20T12:59:41.633 INFO:teuthology.orchestra.run.trial185.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 351 kB/s | 35 kB 00:00 2026-02-20T12:59:41.991 INFO:teuthology.orchestra.run.trial185.stdout:(44/96): python3-babel-2.9.1-2.el9.noarch.rpm 892 kB/s | 6.0 MB 00:06 2026-02-20T12:59:42.557 INFO:teuthology.orchestra.run.trial185.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 781 kB/s | 442 kB 00:00 2026-02-20T12:59:42.734 INFO:teuthology.orchestra.run.trial185.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 436 kB/s | 77 kB 00:00 2026-02-20T12:59:43.067 INFO:teuthology.orchestra.run.trial185.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 803 kB/s | 267 kB 00:00 2026-02-20T12:59:43.322 INFO:teuthology.orchestra.run.trial185.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 623 kB/s | 159 kB 00:00 2026-02-20T12:59:43.654 INFO:teuthology.orchestra.run.trial185.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 838 kB/s | 279 kB 00:00 2026-02-20T12:59:43.754 INFO:teuthology.orchestra.run.trial185.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 543 kB/s | 54 kB 00:00 2026-02-20T12:59:46.161 INFO:teuthology.orchestra.run.trial185.stdout:(51/96): ceph-osd-crimson-20.3.0-5312.g26bc9765 2.6 MB/s | 85 MB 00:33 2026-02-20T12:59:46.582 INFO:teuthology.orchestra.run.trial185.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 99 kB/s | 42 kB 00:00 2026-02-20T12:59:46.880 INFO:teuthology.orchestra.run.trial185.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 635 kB/s | 189 kB 00:00 2026-02-20T12:59:47.057 INFO:teuthology.orchestra.run.trial185.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 509 kB/s | 90 kB 00:00 2026-02-20T12:59:48.688 INFO:teuthology.orchestra.run.trial185.stdout:(55/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 890 kB/s | 6.1 MB 00:07 2026-02-20T12:59:50.074 INFO:teuthology.orchestra.run.trial185.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 7.4 kB/s | 22 kB 00:03 2026-02-20T12:59:50.365 INFO:teuthology.orchestra.run.trial185.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.9 MB/s | 551 kB 00:00 2026-02-20T12:59:50.385 INFO:teuthology.orchestra.run.trial185.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 985 kB/s | 19 kB 00:00 2026-02-20T12:59:50.407 INFO:teuthology.orchestra.run.trial185.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 6.5 MB/s | 151 kB 00:00 2026-02-20T12:59:50.440 INFO:teuthology.orchestra.run.trial185.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 16 MB/s | 548 kB 00:00 2026-02-20T12:59:50.460 INFO:teuthology.orchestra.run.trial185.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 1.5 MB/s | 29 kB 00:00 2026-02-20T12:59:50.480 INFO:teuthology.orchestra.run.trial185.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 2.9 MB/s | 60 kB 00:00 2026-02-20T12:59:50.500 INFO:teuthology.orchestra.run.trial185.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.1 MB/s | 43 kB 00:00 2026-02-20T12:59:50.520 INFO:teuthology.orchestra.run.trial185.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 1.6 MB/s | 32 kB 00:00 2026-02-20T12:59:50.540 INFO:teuthology.orchestra.run.trial185.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 723 kB/s | 14 kB 00:00 2026-02-20T12:59:50.562 INFO:teuthology.orchestra.run.trial185.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 7.5 MB/s | 173 kB 00:00 2026-02-20T12:59:50.589 INFO:teuthology.orchestra.run.trial185.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 13 MB/s | 358 kB 00:00 2026-02-20T12:59:50.613 INFO:teuthology.orchestra.run.trial185.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 10 MB/s | 254 kB 00:00 2026-02-20T12:59:50.674 INFO:teuthology.orchestra.run.trial185.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 34 MB/s | 2.0 MB 00:00 2026-02-20T12:59:50.694 INFO:teuthology.orchestra.run.trial185.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 6.8 MB/s | 144 kB 00:00 2026-02-20T12:59:50.715 INFO:teuthology.orchestra.run.trial185.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 6.5 MB/s | 139 kB 00:00 2026-02-20T12:59:50.735 INFO:teuthology.orchestra.run.trial185.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 2.7 MB/s | 56 kB 00:00 2026-02-20T12:59:50.755 INFO:teuthology.orchestra.run.trial185.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 547 kB/s | 11 kB 00:00 2026-02-20T12:59:50.775 INFO:teuthology.orchestra.run.trial185.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 896 kB/s | 18 kB 00:00 2026-02-20T12:59:50.795 INFO:teuthology.orchestra.run.trial185.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-20T12:59:50.815 INFO:teuthology.orchestra.run.trial185.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 998 kB/s | 20 kB 00:00 2026-02-20T12:59:50.835 INFO:teuthology.orchestra.run.trial185.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 988 kB/s | 19 kB 00:00 2026-02-20T12:59:50.854 INFO:teuthology.orchestra.run.trial185.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 1.3 MB/s | 26 kB 00:00 2026-02-20T12:59:50.884 INFO:teuthology.orchestra.run.trial185.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 34 MB/s | 1.0 MB 00:00 2026-02-20T12:59:50.904 INFO:teuthology.orchestra.run.trial185.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 3.8 MB/s | 79 kB 00:00 2026-02-20T12:59:50.925 INFO:teuthology.orchestra.run.trial185.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 4.2 MB/s | 86 kB 00:00 2026-02-20T12:59:50.945 INFO:teuthology.orchestra.run.trial185.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 2.8 MB/s | 58 kB 00:00 2026-02-20T12:59:50.964 INFO:teuthology.orchestra.run.trial185.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 840 kB/s | 16 kB 00:00 2026-02-20T12:59:50.985 INFO:teuthology.orchestra.run.trial185.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.3 MB/s | 90 kB 00:00 2026-02-20T12:59:51.005 INFO:teuthology.orchestra.run.trial185.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.5 MB/s | 31 kB 00:00 2026-02-20T12:59:51.026 INFO:teuthology.orchestra.run.trial185.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 8.7 MB/s | 188 kB 00:00 2026-02-20T12:59:51.046 INFO:teuthology.orchestra.run.trial185.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 2.9 MB/s | 59 kB 00:00 2026-02-20T12:59:51.067 INFO:teuthology.orchestra.run.trial185.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 5.9 MB/s | 125 kB 00:00 2026-02-20T12:59:51.087 INFO:teuthology.orchestra.run.trial185.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.8 MB/s | 36 kB 00:00 2026-02-20T12:59:51.107 INFO:teuthology.orchestra.run.trial185.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 4.2 MB/s | 86 kB 00:00 2026-02-20T12:59:51.127 INFO:teuthology.orchestra.run.trial185.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 4.3 MB/s | 90 kB 00:00 2026-02-20T12:59:51.148 INFO:teuthology.orchestra.run.trial185.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.3 MB/s | 48 kB 00:00 2026-02-20T12:59:51.168 INFO:teuthology.orchestra.run.trial185.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 1.1 MB/s | 22 kB 00:00 2026-02-20T12:59:51.188 INFO:teuthology.orchestra.run.trial185.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 1.0 MB/s | 20 kB 00:00 2026-02-20T12:59:51.703 INFO:teuthology.orchestra.run.trial185.stdout:(95/96): protobuf-compiler-3.14.0-17.el9.x86_64 286 kB/s | 862 kB 00:03 2026-02-20T13:00:05.715 INFO:teuthology.orchestra.run.trial185.stdout:(96/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 898 kB/s | 19 MB 00:21 2026-02-20T13:00:05.720 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:00:05.720 INFO:teuthology.orchestra.run.trial185.stdout:Total 4.1 MB/s | 223 MB 00:54 2026-02-20T13:00:06.106 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T13:00:06.145 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T13:00:06.145 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T13:00:06.940 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T13:00:06.941 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T13:00:07.773 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T13:00:07.775 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T13:00:07.779 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T13:00:07.801 INFO:teuthology.orchestra.run.trial185.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T13:00:07.835 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T13:00:07.842 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T13:00:07.844 INFO:teuthology.orchestra.run.trial185.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T13:00:07.849 INFO:teuthology.orchestra.run.trial185.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T13:00:07.872 INFO:teuthology.orchestra.run.trial185.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T13:00:07.884 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T13:00:07.888 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T13:00:07.894 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T13:00:07.896 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T13:00:07.907 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T13:00:07.913 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T13:00:07.937 INFO:teuthology.orchestra.run.trial185.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T13:00:07.941 INFO:teuthology.orchestra.run.trial185.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T13:00:07.990 INFO:teuthology.orchestra.run.trial185.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T13:00:08.003 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T13:00:08.005 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T13:00:08.009 INFO:teuthology.orchestra.run.trial185.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T13:00:08.015 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T13:00:08.019 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T13:00:08.022 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T13:00:08.037 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T13:00:08.041 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T13:00:08.046 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T13:00:08.057 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T13:00:08.066 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T13:00:08.072 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T13:00:08.091 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T13:00:08.102 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T13:00:08.117 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T13:00:08.122 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T13:00:08.129 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T13:00:08.169 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T13:00:08.495 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T13:00:08.505 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T13:00:08.509 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T13:00:08.515 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T13:00:08.517 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T13:00:08.544 INFO:teuthology.orchestra.run.trial185.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T13:00:08.588 INFO:teuthology.orchestra.run.trial185.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T13:00:08.596 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T13:00:08.602 INFO:teuthology.orchestra.run.trial185.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T13:00:08.605 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T13:00:08.611 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T13:00:08.615 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T13:00:08.622 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T13:00:08.625 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T13:00:08.653 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T13:00:08.663 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T13:00:08.669 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T13:00:08.676 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T13:00:08.710 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T13:00:08.934 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T13:00:08.958 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T13:00:08.962 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T13:00:09.021 INFO:teuthology.orchestra.run.trial185.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T13:00:09.023 INFO:teuthology.orchestra.run.trial185.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T13:00:09.044 INFO:teuthology.orchestra.run.trial185.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T13:00:09.371 INFO:teuthology.orchestra.run.trial185.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T13:00:09.444 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T13:00:10.118 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T13:00:10.135 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T13:00:10.145 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T13:00:10.152 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T13:00:10.165 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T13:00:10.181 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T13:00:10.257 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T13:00:10.266 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T13:00:10.289 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T13:00:10.319 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T13:00:10.369 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T13:00:10.375 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T13:00:10.379 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T13:00:10.380 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T13:00:10.397 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T13:00:10.397 INFO:teuthology.orchestra.run.trial185.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T13:00:10.398 INFO:teuthology.orchestra.run.trial185.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T13:00:10.398 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:10.405 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T13:00:10.429 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T13:00:10.429 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T13:00:10.429 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:10.466 INFO:teuthology.orchestra.run.trial185.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T13:00:11.063 INFO:teuthology.orchestra.run.trial185.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T13:00:16.400 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_6 80/96 2026-02-20T13:00:16.464 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_6 81/96 2026-02-20T13:00:16.466 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 82/96 2026-02-20T13:00:16.481 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 82/96 2026-02-20T13:00:16.481 INFO:teuthology.orchestra.run.trial185.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:00:16.481 INFO:teuthology.orchestra.run.trial185.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T13:00:16.481 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:16.492 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 83/96 2026-02-20T13:00:16.515 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 83/96 2026-02-20T13:00:16.515 INFO:teuthology.orchestra.run.trial185.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:00:16.515 INFO:teuthology.orchestra.run.trial185.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T13:00:16.515 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:00:16.515 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:00:16.515 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:16.571 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 84/96 2026-02-20T13:00:16.573 INFO:teuthology.orchestra.run.trial185.stdout: Installing : cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 84/96 2026-02-20T13:00:16.582 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5312.g26bc9765.el9 85/96 2026-02-20T13:00:16.606 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5312.g26bc9765.el 86/96 2026-02-20T13:00:16.607 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarc 87/96 2026-02-20T13:00:19.521 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarc 87/96 2026-02-20T13:00:19.528 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noa 88/96 2026-02-20T13:00:19.983 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noa 88/96 2026-02-20T13:00:19.984 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9 89/96 2026-02-20T13:00:19.996 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9 89/96 2026-02-20T13:00:19.996 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noa 90/96 2026-02-20T13:00:20.059 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noa 90/96 2026-02-20T13:00:20.100 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5312.g26bc9765.el9. 91/96 2026-02-20T13:00:20.101 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 92/96 2026-02-20T13:00:20.121 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 92/96 2026-02-20T13:00:20.121 INFO:teuthology.orchestra.run.trial185.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:00:20.121 INFO:teuthology.orchestra.run.trial185.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T13:00:20.121 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:00:20.121 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:00:20.121 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:20.134 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 93/96 2026-02-20T13:00:20.351 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 93/96 2026-02-20T13:00:20.352 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 94/96 2026-02-20T13:00:20.372 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 94/96 2026-02-20T13:00:20.373 INFO:teuthology.orchestra.run.trial185.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:00:20.373 INFO:teuthology.orchestra.run.trial185.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T13:00:20.373 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:00:20.373 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:00:20.373 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:20.457 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 95/96 2026-02-20T13:00:20.476 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 95/96 2026-02-20T13:00:20.477 INFO:teuthology.orchestra.run.trial185.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:00:20.477 INFO:teuthology.orchestra.run.trial185.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T13:00:20.477 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:00:20.477 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:00:20.477 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:20.478 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 96/96 2026-02-20T13:00:20.484 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_6 96/96 2026-02-20T13:00:20.507 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_6 96/96 2026-02-20T13:00:21.872 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 96/96 2026-02-20T13:00:21.872 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 1/96 2026-02-20T13:00:21.872 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 2/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 3/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 4/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 5/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_6 6/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_6 7/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5312.g26bc9765.el 8/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarc 9/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noa 10/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9 11/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noa 12/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5312.g26bc9765.el9. 13/96 2026-02-20T13:00:21.873 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 14/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5312.g26bc9765.el9 15/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 16/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 17/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T13:00:21.874 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T13:00:21.875 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T13:00:21.876 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T13:00:21.877 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T13:00:21.878 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T13:00:21.879 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T13:00:21.880 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T13:00:21.880 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T13:00:21.880 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T13:00:21.880 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T13:00:21.880 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T13:00:21.880 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T13:00:21.880 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T13:00:21.934 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T13:00:21.935 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:21.935 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T13:00:21.935 INFO:teuthology.orchestra.run.trial185.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T13:00:21.935 INFO:teuthology.orchestra.run.trial185.stdout: ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:21.935 INFO:teuthology.orchestra.run.trial185.stdout: ceph-grafana-dashboards-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.935 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:21.935 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:21.935 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.935 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-modules-core-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-prometheus-alerts-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:00:21.936 INFO:teuthology.orchestra.run.trial185.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T13:00:21.937 INFO:teuthology.orchestra.run.trial185.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T13:00:21.938 INFO:teuthology.orchestra.run.trial185.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T13:00:21.939 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T13:00:21.940 INFO:teuthology.orchestra.run.trial185.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T13:00:21.941 INFO:teuthology.orchestra.run.trial185.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T13:00:21.942 INFO:teuthology.orchestra.run.trial185.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T13:00:21.943 INFO:teuthology.orchestra.run.trial185.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T13:00:21.943 INFO:teuthology.orchestra.run.trial185.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T13:00:21.943 INFO:teuthology.orchestra.run.trial185.stdout: zip-3.0-35.el9.x86_64 2026-02-20T13:00:21.943 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:21.943 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:22.003 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-base 2026-02-20T13:00:22.317 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:33 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:22.383 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:22.402 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:22.402 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:22.402 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:22.424 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install cephadm 2026-02-20T13:00:22.735 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:33 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:22.801 INFO:teuthology.orchestra.run.trial185.stdout:Package cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:00:22.819 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:22.820 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:22.820 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:22.842 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T13:00:23.148 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:34 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:23.231 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:23.232 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:23.232 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repo Size 2026-02-20T13:00:23.232 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:23.232 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T13:00:23.232 INFO:teuthology.orchestra.run.trial185.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 149 k 2026-02-20T13:00:23.233 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:23.233 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T13:00:23.233 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:23.233 INFO:teuthology.orchestra.run.trial185.stdout:Install 1 Package 2026-02-20T13:00:23.233 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:23.233 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 149 k 2026-02-20T13:00:23.233 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 455 k 2026-02-20T13:00:23.233 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T13:00:23.817 INFO:teuthology.orchestra.run.trial185.stdout:ceph-immutable-object-cache-20.3.0-5312.g26bc97 255 kB/s | 149 kB 00:00 2026-02-20T13:00:23.817 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:00:23.818 INFO:teuthology.orchestra.run.trial185.stdout:Total 255 kB/s | 149 kB 00:00 2026-02-20T13:00:23.818 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T13:00:23.822 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T13:00:23.823 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T13:00:23.854 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T13:00:23.854 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T13:00:23.909 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T13:00:23.911 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765. 1/1 2026-02-20T13:00:23.933 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765. 1/1 2026-02-20T13:00:23.933 INFO:teuthology.orchestra.run.trial185.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:00:23.933 INFO:teuthology.orchestra.run.trial185.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T13:00:23.934 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:24.214 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765. 1/1 2026-02-20T13:00:24.215 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:24.215 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T13:00:24.215 INFO:teuthology.orchestra.run.trial185.stdout: ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:24.215 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:24.215 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:24.242 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr 2026-02-20T13:00:24.552 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:35 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:24.616 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:24.634 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:24.635 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:24.635 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:24.657 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T13:00:24.973 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:35 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:24.982 INFO:teuthology.orchestra.run.trial114.stdout:(12/12): ceph-test-20.3.0-5312.g26bc9765.el9.x8 1.7 MB/s | 125 MB 01:14 2026-02-20T13:00:24.985 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:00:24.985 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.6 MB/s | 129 MB 01:21 2026-02-20T13:00:25.038 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:00:25.056 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:00:25.057 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:25.058 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:25.058 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:25.068 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:00:25.068 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:00:25.080 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T13:00:25.392 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:36 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:25.458 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:00:25.476 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:25.477 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:25.477 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:25.491 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:00:25.491 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:00:25.499 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr-rook 2026-02-20T13:00:25.814 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:36 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:25.879 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:00:25.898 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:25.898 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:25.899 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:25.920 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T13:00:25.942 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:00:25.951 INFO:teuthology.orchestra.run.trial114.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T13:00:25.960 INFO:teuthology.orchestra.run.trial114.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T13:00:25.965 INFO:teuthology.orchestra.run.trial114.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T13:00:25.969 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T13:00:25.971 INFO:teuthology.orchestra.run.trial114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T13:00:25.975 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T13:00:25.976 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T13:00:25.995 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T13:00:25.997 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T13:00:26.007 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T13:00:26.016 INFO:teuthology.orchestra.run.trial114.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T13:00:26.016 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 11/12 2026-02-20T13:00:26.229 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:37 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:26.292 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:00:26.311 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:26.312 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:26.312 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:26.333 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-osd 2026-02-20T13:00:26.644 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:37 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:26.709 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:26.728 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:26.728 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:26.728 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:26.750 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-osd-classic 2026-02-20T13:00:27.060 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:38 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:27.126 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:27.144 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:27.145 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:27.145 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:27.169 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-fuse 2026-02-20T13:00:27.480 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:38 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:27.564 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:27.564 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:27.564 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repo Size 2026-02-20T13:00:27.564 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:27.564 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T13:00:27.564 INFO:teuthology.orchestra.run.trial185.stdout: ceph-fuse x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 914 k 2026-02-20T13:00:27.564 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:27.565 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T13:00:27.565 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:27.565 INFO:teuthology.orchestra.run.trial185.stdout:Install 1 Package 2026-02-20T13:00:27.565 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:27.565 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 914 k 2026-02-20T13:00:27.565 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 2.9 M 2026-02-20T13:00:27.565 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T13:00:28.177 INFO:teuthology.orchestra.run.trial185.stdout:ceph-fuse-20.3.0-5312.g26bc9765.el9.x86_64.rpm 1.5 MB/s | 914 kB 00:00 2026-02-20T13:00:28.178 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:00:28.178 INFO:teuthology.orchestra.run.trial185.stdout:Total 1.5 MB/s | 914 kB 00:00 2026-02-20T13:00:28.178 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T13:00:28.183 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T13:00:28.183 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T13:00:28.217 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T13:00:28.217 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T13:00:28.307 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T13:00:28.324 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:28.542 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:28.599 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:28.599 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:28.600 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T13:00:28.600 INFO:teuthology.orchestra.run.trial185.stdout: ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:28.600 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:28.600 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:28.628 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-volume 2026-02-20T13:00:28.939 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:39 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:29.005 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:00:29.025 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:29.025 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:29.026 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:29.047 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install librados-devel 2026-02-20T13:00:29.356 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:40 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:29.440 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:29.440 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:29.440 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repo Size 2026-02-20T13:00:29.441 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:29.441 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T13:00:29.441 INFO:teuthology.orchestra.run.trial185.stdout: librados-devel x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 124 k 2026-02-20T13:00:29.441 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:29.441 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T13:00:29.441 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:29.441 INFO:teuthology.orchestra.run.trial185.stdout:Install 1 Package 2026-02-20T13:00:29.441 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:29.442 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 124 k 2026-02-20T13:00:29.442 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 434 k 2026-02-20T13:00:29.442 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T13:00:29.902 INFO:teuthology.orchestra.run.trial185.stdout:librados-devel-20.3.0-5312.g26bc9765.el9.x86_64 268 kB/s | 124 kB 00:00 2026-02-20T13:00:29.903 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:00:29.903 INFO:teuthology.orchestra.run.trial185.stdout:Total 267 kB/s | 124 kB 00:00 2026-02-20T13:00:29.903 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T13:00:29.905 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T13:00:29.906 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T13:00:29.938 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T13:00:29.938 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T13:00:29.992 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T13:00:30.009 INFO:teuthology.orchestra.run.trial185.stdout: Installing : librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:30.098 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:30.155 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:30.155 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:30.155 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T13:00:30.155 INFO:teuthology.orchestra.run.trial185.stdout: librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:30.156 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:30.156 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:30.183 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install libcephfs2 2026-02-20T13:00:30.509 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:41 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:30.574 INFO:teuthology.orchestra.run.trial185.stdout:Package libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:30.593 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:30.593 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:30.593 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:30.615 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install libcephfs-devel 2026-02-20T13:00:30.929 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:41 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:31.011 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:31.012 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:31.012 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repo Size 2026-02-20T13:00:31.012 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:31.012 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T13:00:31.013 INFO:teuthology.orchestra.run.trial185.stdout: libcephfs-devel x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 37 k 2026-02-20T13:00:31.013 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:31.013 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T13:00:31.013 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:31.013 INFO:teuthology.orchestra.run.trial185.stdout:Install 1 Package 2026-02-20T13:00:31.013 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:31.013 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 37 k 2026-02-20T13:00:31.013 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 171 k 2026-02-20T13:00:31.013 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T13:00:31.343 INFO:teuthology.orchestra.run.trial185.stdout:libcephfs-devel-20.3.0-5312.g26bc9765.el9.x86_6 113 kB/s | 37 kB 00:00 2026-02-20T13:00:31.343 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:00:31.343 INFO:teuthology.orchestra.run.trial185.stdout:Total 113 kB/s | 37 kB 00:00 2026-02-20T13:00:31.343 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T13:00:31.346 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T13:00:31.346 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T13:00:31.348 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T13:00:31.348 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T13:00:31.370 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T13:00:31.386 INFO:teuthology.orchestra.run.trial185.stdout: Installing : libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:31.440 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:31.497 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:31.497 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:31.497 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T13:00:31.497 INFO:teuthology.orchestra.run.trial185.stdout: libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:31.497 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:31.497 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:31.523 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install librados2 2026-02-20T13:00:31.836 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:42 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:31.903 INFO:teuthology.orchestra.run.trial185.stdout:Package librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:31.922 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:31.923 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:31.923 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:31.945 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install librbd1 2026-02-20T13:00:32.253 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:43 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:32.317 INFO:teuthology.orchestra.run.trial185.stdout:Package librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:32.336 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:32.336 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:32.336 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:32.358 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install python3-rados 2026-02-20T13:00:32.669 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:43 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:32.735 INFO:teuthology.orchestra.run.trial185.stdout:Package python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:32.753 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:32.754 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:32.754 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:32.776 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install python3-rgw 2026-02-20T13:00:32.818 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 11/12 2026-02-20T13:00:32.836 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 12/12 2026-02-20T13:00:33.082 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:44 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:33.147 INFO:teuthology.orchestra.run.trial185.stdout:Package python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:33.166 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:33.166 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:33.166 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:33.188 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install python3-cephfs 2026-02-20T13:00:33.496 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:44 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:33.560 INFO:teuthology.orchestra.run.trial185.stdout:Package python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:33.578 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:33.579 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:33.579 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:33.601 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install python3-rbd 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 12/12 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 1/12 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 2/12 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T13:00:33.606 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T13:00:33.607 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T13:00:33.607 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T13:00:33.659 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T13:00:33.659 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:00:33.659 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:00:33.659 INFO:teuthology.orchestra.run.trial114.stdout: ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:33.659 INFO:teuthology.orchestra.run.trial114.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T13:00:33.659 INFO:teuthology.orchestra.run.trial114.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: libcephsqlite-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:00:33.660 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:00:33.698 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph 2026-02-20T13:00:33.907 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:44 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:33.973 INFO:teuthology.orchestra.run.trial185.stdout:Package python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:33.991 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:33.992 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:33.992 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:33.999 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:01:58 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:00:34.013 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install rbd-fuse 2026-02-20T13:00:34.085 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:00:34.088 INFO:teuthology.orchestra.run.trial114.stdout:======================================================================================= 2026-02-20T13:00:34.088 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repository Size 2026-02-20T13:00:34.088 INFO:teuthology.orchestra.run.trial114.stdout:======================================================================================= 2026-02-20T13:00:34.088 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: ceph x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 6.5 k 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout:Installing dependencies: 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 57 k 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mds x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 2.0 M 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 937 k 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 297 k 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mon x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 4.9 M 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 163 k 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-classic x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 15 M 2026-02-20T13:00:34.089 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-crimson x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 85 M 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 17 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: cephadm noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 1.0 M 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T13:00:34.090 INFO:teuthology.orchestra.run.trial114.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T13:00:34.091 INFO:teuthology.orchestra.run.trial114.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T13:00:34.092 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T13:00:34.093 INFO:teuthology.orchestra.run.trial114.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T13:00:34.094 INFO:teuthology.orchestra.run.trial114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T13:00:34.095 INFO:teuthology.orchestra.run.trial114.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout:Installing weak dependencies: 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 184 k 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 51 M 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 7.4 M 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 22 k 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-rook noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 50 k 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout: ceph-volume noarch 2:20.3.0-5312.g26bc9765.el9 ceph-noarch 299 k 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T13:00:34.096 INFO:teuthology.orchestra.run.trial114.stdout:======================================================================================= 2026-02-20T13:00:34.097 INFO:teuthology.orchestra.run.trial114.stdout:Install 96 Packages 2026-02-20T13:00:34.097 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:00:34.097 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 223 M 2026-02-20T13:00:34.098 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 1.5 G 2026-02-20T13:00:34.098 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T13:00:34.330 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:45 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:34.416 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout: Package Architecture Version Repository Size 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout: rbd-fuse x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 87 k 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout:Install 1 Package 2026-02-20T13:00:34.417 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:34.418 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 87 k 2026-02-20T13:00:34.418 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 236 k 2026-02-20T13:00:34.418 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T13:00:34.769 INFO:teuthology.orchestra.run.trial185.stdout:rbd-fuse-20.3.0-5312.g26bc9765.el9.x86_64.rpm 246 kB/s | 87 kB 00:00 2026-02-20T13:00:34.770 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:00:34.770 INFO:teuthology.orchestra.run.trial185.stdout:Total 245 kB/s | 87 kB 00:00 2026-02-20T13:00:34.770 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T13:00:34.774 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T13:00:34.774 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T13:00:34.805 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T13:00:34.805 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T13:00:34.856 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T13:00:34.873 INFO:teuthology.orchestra.run.trial185.stdout: Installing : rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:34.952 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:35.011 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:35.011 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:35.011 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T13:00:35.011 INFO:teuthology.orchestra.run.trial185.stdout: rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:35.011 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:35.011 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:35.039 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install rbd-mirror 2026-02-20T13:00:35.344 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:46 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:35.427 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:35.428 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:35.428 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repo Size 2026-02-20T13:00:35.428 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:35.428 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T13:00:35.428 INFO:teuthology.orchestra.run.trial185.stdout: rbd-mirror x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 2.6 M 2026-02-20T13:00:35.428 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:35.428 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T13:00:35.428 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:35.428 INFO:teuthology.orchestra.run.trial185.stdout:Install 1 Package 2026-02-20T13:00:35.429 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:35.429 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 2.6 M 2026-02-20T13:00:35.429 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 11 M 2026-02-20T13:00:35.429 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T13:00:36.180 INFO:teuthology.orchestra.run.trial185.stdout:rbd-mirror-20.3.0-5312.g26bc9765.el9.x86_64.rpm 3.5 MB/s | 2.6 MB 00:00 2026-02-20T13:00:36.180 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:00:36.180 INFO:teuthology.orchestra.run.trial185.stdout:Total 3.4 MB/s | 2.6 MB 00:00 2026-02-20T13:00:36.181 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T13:00:36.185 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T13:00:36.185 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T13:00:36.224 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T13:00:36.224 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T13:00:36.387 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T13:00:36.389 INFO:teuthology.orchestra.run.trial185.stdout: Installing : rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:36.411 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:36.411 INFO:teuthology.orchestra.run.trial185.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:00:36.411 INFO:teuthology.orchestra.run.trial185.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T13:00:36.412 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:00:36.412 INFO:teuthology.orchestra.run.trial185.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:00:36.412 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:36.701 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:36.701 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:36.701 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T13:00:36.701 INFO:teuthology.orchestra.run.trial185.stdout: rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:36.701 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:36.702 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:36.730 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install rbd-nbd 2026-02-20T13:00:36.842 INFO:teuthology.orchestra.run.trial114.stdout:(1/96): ceph-20.3.0-5312.g26bc9765.el9.x86_64.r 25 kB/s | 6.5 kB 00:00 2026-02-20T13:00:37.041 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:48 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:37.125 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:37.126 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:37.126 INFO:teuthology.orchestra.run.trial185.stdout: Package Architecture Version Repository Size 2026-02-20T13:00:37.126 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout: rbd-nbd x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 166 k 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout:Install 1 Package 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 166 k 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 496 k 2026-02-20T13:00:37.127 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T13:00:37.286 INFO:teuthology.orchestra.run.trial114.stdout:(2/96): ceph-mgr-20.3.0-5312.g26bc9765.el9.x86_ 1.3 MB/s | 937 kB 00:00 2026-02-20T13:00:37.342 INFO:teuthology.orchestra.run.trial114.stdout:(3/96): ceph-osd-20.3.0-5312.g26bc9765.el9.x86_ 2.8 MB/s | 163 kB 00:00 2026-02-20T13:00:37.536 INFO:teuthology.orchestra.run.trial185.stdout:rbd-nbd-20.3.0-5312.g26bc9765.el9.x86_64.rpm 406 kB/s | 166 kB 00:00 2026-02-20T13:00:37.537 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:00:37.537 INFO:teuthology.orchestra.run.trial185.stdout:Total 405 kB/s | 166 kB 00:00 2026-02-20T13:00:37.537 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T13:00:37.542 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T13:00:37.542 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T13:00:37.573 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T13:00:37.574 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T13:00:37.630 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T13:00:37.648 INFO:teuthology.orchestra.run.trial185.stdout: Installing : rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:37.679 INFO:teuthology.orchestra.run.trial114.stdout:(4/96): ceph-mds-20.3.0-5312.g26bc9765.el9.x86_ 1.8 MB/s | 2.0 MB 00:01 2026-02-20T13:00:37.729 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:37.787 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:00:37.787 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:37.787 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T13:00:37.787 INFO:teuthology.orchestra.run.trial185.stdout: rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:00:37.787 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:37.787 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:37.815 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-osd-crimson 2026-02-20T13:00:38.126 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:49 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:38.190 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:00:38.208 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:38.209 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:00:38.209 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:00:38.231 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T13:00:38.542 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:02:49 ago on Fri 20 Feb 2026 12:57:49 PM UTC. 2026-02-20T13:00:38.627 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:00:38.628 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:38.628 INFO:teuthology.orchestra.run.trial185.stdout: Package Arch Version Repo Size 2026-02-20T13:00:38.628 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:38.628 INFO:teuthology.orchestra.run.trial185.stdout:Installing: 2026-02-20T13:00:38.628 INFO:teuthology.orchestra.run.trial185.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 425 M 2026-02-20T13:00:38.628 INFO:teuthology.orchestra.run.trial185.stdout:Installing weak dependencies: 2026-02-20T13:00:38.628 INFO:teuthology.orchestra.run.trial185.stdout: ceph-debugsource x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 12 M 2026-02-20T13:00:38.628 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:38.629 INFO:teuthology.orchestra.run.trial185.stdout:Transaction Summary 2026-02-20T13:00:38.629 INFO:teuthology.orchestra.run.trial185.stdout:================================================================================ 2026-02-20T13:00:38.629 INFO:teuthology.orchestra.run.trial185.stdout:Install 2 Packages 2026-02-20T13:00:38.629 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:00:38.629 INFO:teuthology.orchestra.run.trial185.stdout:Total download size: 437 M 2026-02-20T13:00:38.629 INFO:teuthology.orchestra.run.trial185.stdout:Installed size: 2.6 G 2026-02-20T13:00:38.629 INFO:teuthology.orchestra.run.trial185.stdout:Downloading Packages: 2026-02-20T13:00:41.445 INFO:teuthology.orchestra.run.trial114.stdout:(5/96): ceph-osd-classic-20.3.0-5312.g26bc9765. 3.6 MB/s | 15 MB 00:04 2026-02-20T13:00:41.509 INFO:teuthology.orchestra.run.trial114.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5312.g26 896 kB/s | 57 kB 00:00 2026-02-20T13:00:41.572 INFO:teuthology.orchestra.run.trial114.stdout:(7/96): ceph-mon-20.3.0-5312.g26bc9765.el9.x86_ 1.0 MB/s | 4.9 MB 00:04 2026-02-20T13:00:41.634 INFO:teuthology.orchestra.run.trial114.stdout:(8/96): ceph-mgr-cephadm-20.3.0-5312.g26bc9765. 1.4 MB/s | 184 kB 00:00 2026-02-20T13:00:43.534 INFO:teuthology.orchestra.run.trial185.stdout:(1/2): ceph-debugsource-20.3.0-5312.g26bc9765.e 2.5 MB/s | 12 MB 00:04 2026-02-20T13:00:44.863 INFO:teuthology.orchestra.run.trial114.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 2.3 MB/s | 7.4 MB 00:03 2026-02-20T13:00:44.935 INFO:teuthology.orchestra.run.trial114.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5312.g26bc97 307 kB/s | 22 kB 00:00 2026-02-20T13:00:45.257 INFO:teuthology.orchestra.run.trial114.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5312.g26b 923 kB/s | 297 kB 00:00 2026-02-20T13:00:45.318 INFO:teuthology.orchestra.run.trial114.stdout:(12/96): ceph-mgr-rook-20.3.0-5312.g26bc9765.el 828 kB/s | 50 kB 00:00 2026-02-20T13:00:45.379 INFO:teuthology.orchestra.run.trial114.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5312.g26 285 kB/s | 17 kB 00:00 2026-02-20T13:00:45.568 INFO:teuthology.orchestra.run.trial114.stdout:(14/96): ceph-volume-20.3.0-5312.g26bc9765.el9. 1.5 MB/s | 299 kB 00:00 2026-02-20T13:00:46.166 INFO:teuthology.orchestra.run.trial114.stdout:(15/96): cephadm-20.3.0-5312.g26bc9765.el9.noar 1.7 MB/s | 1.0 MB 00:00 2026-02-20T13:00:47.506 INFO:teuthology.orchestra.run.trial114.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 262 kB/s | 351 kB 00:01 2026-02-20T13:00:47.941 INFO:teuthology.orchestra.run.trial114.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 93 kB/s | 40 kB 00:00 2026-02-20T13:00:48.267 INFO:teuthology.orchestra.run.trial114.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 221 kB/s | 72 kB 00:00 2026-02-20T13:00:49.867 INFO:teuthology.orchestra.run.trial114.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 496 kB/s | 794 kB 00:01 2026-02-20T13:00:50.455 INFO:teuthology.orchestra.run.trial114.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 314 kB/s | 184 kB 00:00 2026-02-20T13:00:51.134 INFO:teuthology.orchestra.run.trial114.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 373 kB/s | 253 kB 00:00 2026-02-20T13:00:53.236 INFO:teuthology.orchestra.run.trial114.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 607 kB/s | 1.2 MB 00:02 2026-02-20T13:00:53.712 INFO:teuthology.orchestra.run.trial114.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 223 kB/s | 106 kB 00:00 2026-02-20T13:00:54.187 INFO:teuthology.orchestra.run.trial114.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 285 kB/s | 135 kB 00:00 2026-02-20T13:00:54.613 INFO:teuthology.orchestra.run.trial114.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 354 kB/s | 150 kB 00:00 2026-02-20T13:00:55.127 INFO:teuthology.orchestra.run.trial114.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 246 kB/s | 126 kB 00:00 2026-02-20T13:00:55.753 INFO:teuthology.orchestra.run.trial114.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 348 kB/s | 218 kB 00:00 2026-02-20T13:00:56.708 INFO:teuthology.orchestra.run.trial114.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 190 kB/s | 182 kB 00:00 2026-02-20T13:00:57.968 INFO:teuthology.orchestra.run.trial114.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 211 kB/s | 266 kB 00:01 2026-02-20T13:00:59.120 INFO:teuthology.orchestra.run.trial114.stdout:(30/96): ceph-mgr-dashboard-20.3.0-5312.g26bc97 2.9 MB/s | 51 MB 00:17 2026-02-20T13:00:59.322 INFO:teuthology.orchestra.run.trial114.stdout:(31/96): flexiblas-3.0.4-9.el9.x86_64.rpm 22 kB/s | 30 kB 00:01 2026-02-20T13:00:59.355 INFO:teuthology.orchestra.run.trial114.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 457 kB/s | 15 kB 00:00 2026-02-20T13:00:59.456 INFO:teuthology.orchestra.run.trial114.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.4 MB/s | 246 kB 00:00 2026-02-20T13:00:59.492 INFO:teuthology.orchestra.run.trial114.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 5.1 MB/s | 188 kB 00:00 2026-02-20T13:00:59.519 INFO:teuthology.orchestra.run.trial114.stdout:(35/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 7.5 MB/s | 3.0 MB 00:00 2026-02-20T13:00:59.519 INFO:teuthology.orchestra.run.trial114.stdout:(36/96): openblas-0.3.29-1.el9.x86_64.rpm 1.5 MB/s | 42 kB 00:00 2026-02-20T13:00:59.589 INFO:teuthology.orchestra.run.trial114.stdout:(37/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 75 MB/s | 5.3 MB 00:00 2026-02-20T13:00:59.618 INFO:teuthology.orchestra.run.trial114.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 8.3 MB/s | 244 kB 00:00 2026-02-20T13:00:59.647 INFO:teuthology.orchestra.run.trial114.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.3 MB/s | 249 kB 00:00 2026-02-20T13:00:59.664 INFO:teuthology.orchestra.run.trial114.stdout:(40/96): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 6.0 MB 00:00 2026-02-20T13:00:59.674 INFO:teuthology.orchestra.run.trial114.stdout:(41/96): python3-jmespath-1.0.1-1.el9.noarch.rp 1.8 MB/s | 48 kB 00:00 2026-02-20T13:00:59.692 INFO:teuthology.orchestra.run.trial114.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 6.1 MB/s | 177 kB 00:00 2026-02-20T13:00:59.705 INFO:teuthology.orchestra.run.trial114.stdout:(43/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 40 MB/s | 1.2 MB 00:00 2026-02-20T13:00:59.718 INFO:teuthology.orchestra.run.trial114.stdout:(44/96): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-20T13:00:59.747 INFO:teuthology.orchestra.run.trial114.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-20T13:00:59.773 INFO:teuthology.orchestra.run.trial114.stdout:(46/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 90 MB/s | 6.1 MB 00:00 2026-02-20T13:00:59.774 INFO:teuthology.orchestra.run.trial114.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 2.8 MB/s | 77 kB 00:00 2026-02-20T13:00:59.801 INFO:teuthology.orchestra.run.trial114.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.7 MB/s | 159 kB 00:00 2026-02-20T13:00:59.802 INFO:teuthology.orchestra.run.trial114.stdout:(49/96): python3-protobuf-3.14.0-17.el9.noarch. 9.0 MB/s | 267 kB 00:00 2026-02-20T13:00:59.830 INFO:teuthology.orchestra.run.trial114.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 9.6 MB/s | 279 kB 00:00 2026-02-20T13:00:59.831 INFO:teuthology.orchestra.run.trial114.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 1.9 MB/s | 54 kB 00:00 2026-02-20T13:00:59.858 INFO:teuthology.orchestra.run.trial114.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-20T13:00:59.885 INFO:teuthology.orchestra.run.trial114.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.0 MB/s | 189 kB 00:00 2026-02-20T13:00:59.913 INFO:teuthology.orchestra.run.trial114.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.1 MB/s | 90 kB 00:00 2026-02-20T13:01:00.031 INFO:teuthology.orchestra.run.trial114.stdout:(55/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 96 MB/s | 19 MB 00:00 2026-02-20T13:01:00.325 INFO:teuthology.orchestra.run.trial114.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 54 kB/s | 22 kB 00:00 2026-02-20T13:01:00.586 INFO:teuthology.orchestra.run.trial114.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.1 MB/s | 551 kB 00:00 2026-02-20T13:01:00.603 INFO:teuthology.orchestra.run.trial114.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2026-02-20T13:01:00.622 INFO:teuthology.orchestra.run.trial114.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 7.7 MB/s | 151 kB 00:00 2026-02-20T13:01:00.651 INFO:teuthology.orchestra.run.trial114.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 18 MB/s | 548 kB 00:00 2026-02-20T13:01:00.671 INFO:teuthology.orchestra.run.trial114.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 1.4 MB/s | 29 kB 00:00 2026-02-20T13:01:00.691 INFO:teuthology.orchestra.run.trial114.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 3.0 MB/s | 60 kB 00:00 2026-02-20T13:01:00.709 INFO:teuthology.orchestra.run.trial114.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.4 MB/s | 43 kB 00:00 2026-02-20T13:01:00.726 INFO:teuthology.orchestra.run.trial114.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 1.8 MB/s | 32 kB 00:00 2026-02-20T13:01:00.743 INFO:teuthology.orchestra.run.trial114.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 839 kB/s | 14 kB 00:00 2026-02-20T13:01:00.762 INFO:teuthology.orchestra.run.trial114.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 8.8 MB/s | 173 kB 00:00 2026-02-20T13:01:00.786 INFO:teuthology.orchestra.run.trial114.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 15 MB/s | 358 kB 00:00 2026-02-20T13:01:00.809 INFO:teuthology.orchestra.run.trial114.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 11 MB/s | 254 kB 00:00 2026-02-20T13:01:00.867 INFO:teuthology.orchestra.run.trial114.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 35 MB/s | 2.0 MB 00:00 2026-02-20T13:01:00.886 INFO:teuthology.orchestra.run.trial114.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 7.5 MB/s | 144 kB 00:00 2026-02-20T13:01:00.905 INFO:teuthology.orchestra.run.trial114.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 7.2 MB/s | 139 kB 00:00 2026-02-20T13:01:00.923 INFO:teuthology.orchestra.run.trial114.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 3.1 MB/s | 56 kB 00:00 2026-02-20T13:01:00.940 INFO:teuthology.orchestra.run.trial114.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 640 kB/s | 11 kB 00:00 2026-02-20T13:01:00.957 INFO:teuthology.orchestra.run.trial114.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2026-02-20T13:01:00.974 INFO:teuthology.orchestra.run.trial114.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 1.4 MB/s | 23 kB 00:00 2026-02-20T13:01:00.991 INFO:teuthology.orchestra.run.trial114.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 1.1 MB/s | 20 kB 00:00 2026-02-20T13:01:01.011 INFO:teuthology.orchestra.run.trial114.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 987 kB/s | 19 kB 00:00 2026-02-20T13:01:01.029 INFO:teuthology.orchestra.run.trial114.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 1.4 MB/s | 26 kB 00:00 2026-02-20T13:01:01.053 INFO:teuthology.orchestra.run.trial114.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 43 MB/s | 1.0 MB 00:00 2026-02-20T13:01:01.073 INFO:teuthology.orchestra.run.trial114.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 3.9 MB/s | 79 kB 00:00 2026-02-20T13:01:01.091 INFO:teuthology.orchestra.run.trial114.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 4.6 MB/s | 86 kB 00:00 2026-02-20T13:01:01.109 INFO:teuthology.orchestra.run.trial114.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 3.2 MB/s | 58 kB 00:00 2026-02-20T13:01:01.126 INFO:teuthology.orchestra.run.trial114.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 971 kB/s | 16 kB 00:00 2026-02-20T13:01:01.145 INFO:teuthology.orchestra.run.trial114.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.7 MB/s | 90 kB 00:00 2026-02-20T13:01:01.163 INFO:teuthology.orchestra.run.trial114.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.7 MB/s | 31 kB 00:00 2026-02-20T13:01:01.181 INFO:teuthology.orchestra.run.trial114.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 10 MB/s | 188 kB 00:00 2026-02-20T13:01:01.198 INFO:teuthology.orchestra.run.trial114.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 3.3 MB/s | 59 kB 00:00 2026-02-20T13:01:01.218 INFO:teuthology.orchestra.run.trial114.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 6.3 MB/s | 125 kB 00:00 2026-02-20T13:01:01.237 INFO:teuthology.orchestra.run.trial114.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.9 MB/s | 36 kB 00:00 2026-02-20T13:01:01.254 INFO:teuthology.orchestra.run.trial114.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 4.8 MB/s | 86 kB 00:00 2026-02-20T13:01:01.272 INFO:teuthology.orchestra.run.trial114.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 5.0 MB/s | 90 kB 00:00 2026-02-20T13:01:01.289 INFO:teuthology.orchestra.run.trial114.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.8 MB/s | 48 kB 00:00 2026-02-20T13:01:01.307 INFO:teuthology.orchestra.run.trial114.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 1.2 MB/s | 22 kB 00:00 2026-02-20T13:01:01.324 INFO:teuthology.orchestra.run.trial114.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2026-02-20T13:01:01.389 INFO:teuthology.orchestra.run.trial114.stdout:(95/96): protobuf-compiler-3.14.0-17.el9.x86_64 635 kB/s | 862 kB 00:01 2026-02-20T13:01:16.530 INFO:teuthology.orchestra.run.trial114.stdout:(96/96): ceph-osd-crimson-20.3.0-5312.g26bc9765 2.2 MB/s | 85 MB 00:38 2026-02-20T13:01:16.533 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:01:16.533 INFO:teuthology.orchestra.run.trial114.stdout:Total 5.3 MB/s | 223 MB 00:42 2026-02-20T13:01:16.919 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:01:16.959 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:01:16.960 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:01:17.752 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:01:17.752 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:01:18.590 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T13:01:18.618 INFO:teuthology.orchestra.run.trial114.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T13:01:18.654 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T13:01:18.660 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T13:01:18.662 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T13:01:18.667 INFO:teuthology.orchestra.run.trial114.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T13:01:18.690 INFO:teuthology.orchestra.run.trial114.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T13:01:18.703 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T13:01:18.707 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T13:01:18.713 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T13:01:18.715 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T13:01:18.726 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T13:01:18.732 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T13:01:18.756 INFO:teuthology.orchestra.run.trial114.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T13:01:18.759 INFO:teuthology.orchestra.run.trial114.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T13:01:18.810 INFO:teuthology.orchestra.run.trial114.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T13:01:18.823 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T13:01:18.825 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T13:01:18.830 INFO:teuthology.orchestra.run.trial114.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T13:01:18.835 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T13:01:18.840 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T13:01:18.843 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T13:01:18.857 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T13:01:18.862 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T13:01:18.867 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T13:01:18.879 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T13:01:18.888 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T13:01:18.894 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T13:01:18.914 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T13:01:18.925 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T13:01:18.941 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T13:01:18.945 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T13:01:18.953 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T13:01:18.993 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T13:01:19.320 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T13:01:19.330 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T13:01:19.334 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T13:01:19.340 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T13:01:19.342 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T13:01:19.369 INFO:teuthology.orchestra.run.trial114.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T13:01:19.413 INFO:teuthology.orchestra.run.trial114.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T13:01:19.421 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T13:01:19.427 INFO:teuthology.orchestra.run.trial114.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T13:01:19.430 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T13:01:19.436 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T13:01:19.440 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T13:01:19.447 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T13:01:19.450 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T13:01:19.478 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T13:01:19.488 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T13:01:19.494 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T13:01:19.501 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T13:01:19.536 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T13:01:19.761 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T13:01:19.785 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T13:01:19.789 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T13:01:19.847 INFO:teuthology.orchestra.run.trial114.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T13:01:19.849 INFO:teuthology.orchestra.run.trial114.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T13:01:19.871 INFO:teuthology.orchestra.run.trial114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T13:01:20.199 INFO:teuthology.orchestra.run.trial114.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T13:01:20.272 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T13:01:20.948 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T13:01:20.964 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T13:01:20.975 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T13:01:20.982 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T13:01:20.995 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T13:01:21.011 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T13:01:21.088 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T13:01:21.096 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T13:01:21.120 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T13:01:21.150 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T13:01:21.201 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T13:01:21.207 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T13:01:21.211 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T13:01:21.212 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T13:01:21.231 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T13:01:21.231 INFO:teuthology.orchestra.run.trial114.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T13:01:21.231 INFO:teuthology.orchestra.run.trial114.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T13:01:21.231 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:21.238 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T13:01:21.263 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T13:01:21.263 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T13:01:21.263 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:21.297 INFO:teuthology.orchestra.run.trial114.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T13:01:21.882 INFO:teuthology.orchestra.run.trial114.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T13:01:27.145 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_6 80/96 2026-02-20T13:01:27.209 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_6 81/96 2026-02-20T13:01:27.211 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 82/96 2026-02-20T13:01:27.225 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 82/96 2026-02-20T13:01:27.225 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:01:27.226 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T13:01:27.226 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:27.238 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 83/96 2026-02-20T13:01:27.262 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 83/96 2026-02-20T13:01:27.263 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:01:27.263 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T13:01:27.263 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:01:27.263 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T13:01:27.263 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:27.321 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 84/96 2026-02-20T13:01:27.323 INFO:teuthology.orchestra.run.trial114.stdout: Installing : cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 84/96 2026-02-20T13:01:27.332 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5312.g26bc9765.el9 85/96 2026-02-20T13:01:27.356 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5312.g26bc9765.el 86/96 2026-02-20T13:01:27.357 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarc 87/96 2026-02-20T13:01:30.268 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarc 87/96 2026-02-20T13:01:30.275 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noa 88/96 2026-02-20T13:01:30.735 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noa 88/96 2026-02-20T13:01:30.736 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9 89/96 2026-02-20T13:01:30.748 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9 89/96 2026-02-20T13:01:30.748 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noa 90/96 2026-02-20T13:01:30.812 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noa 90/96 2026-02-20T13:01:30.852 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5312.g26bc9765.el9. 91/96 2026-02-20T13:01:30.853 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 92/96 2026-02-20T13:01:30.875 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 92/96 2026-02-20T13:01:30.875 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:01:30.875 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T13:01:30.875 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:01:30.875 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T13:01:30.875 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:30.887 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 93/96 2026-02-20T13:01:31.102 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 93/96 2026-02-20T13:01:31.103 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 94/96 2026-02-20T13:01:31.125 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 94/96 2026-02-20T13:01:31.125 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:01:31.125 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T13:01:31.125 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:01:31.125 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T13:01:31.126 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:31.209 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 95/96 2026-02-20T13:01:31.229 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 95/96 2026-02-20T13:01:31.230 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:01:31.230 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T13:01:31.230 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:01:31.230 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T13:01:31.230 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:31.231 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 96/96 2026-02-20T13:01:31.237 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_6 96/96 2026-02-20T13:01:31.260 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_6 96/96 2026-02-20T13:01:32.646 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 96/96 2026-02-20T13:01:32.646 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 1/96 2026-02-20T13:01:32.646 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 2/96 2026-02-20T13:01:32.646 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 3/96 2026-02-20T13:01:32.646 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 4/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 5/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_6 6/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_6 7/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5312.g26bc9765.el 8/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarc 9/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noa 10/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9 11/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noa 12/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5312.g26bc9765.el9. 13/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 14/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5312.g26bc9765.el9 15/96 2026-02-20T13:01:32.647 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 16/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 17/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T13:01:32.648 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T13:01:32.649 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T13:01:32.650 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T13:01:32.651 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T13:01:32.652 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T13:01:32.653 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T13:01:32.654 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T13:01:32.712 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T13:01:32.712 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: ceph-grafana-dashboards-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mds-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-k8sevents-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.713 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-modules-core-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: ceph-mon-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: ceph-prometheus-alerts-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: cephadm-2:20.3.0-5312.g26bc9765.el9.noarch 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T13:01:32.714 INFO:teuthology.orchestra.run.trial114.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T13:01:32.715 INFO:teuthology.orchestra.run.trial114.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T13:01:32.716 INFO:teuthology.orchestra.run.trial114.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T13:01:32.717 INFO:teuthology.orchestra.run.trial114.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T13:01:32.718 INFO:teuthology.orchestra.run.trial114.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T13:01:32.719 INFO:teuthology.orchestra.run.trial114.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: zip-3.0-35.el9.x86_64 2026-02-20T13:01:32.720 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:32.721 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:32.778 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-base 2026-02-20T13:01:33.094 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:02:58 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:33.158 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:33.177 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:33.177 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:33.177 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:33.200 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install cephadm 2026-02-20T13:01:33.506 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:02:58 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:33.571 INFO:teuthology.orchestra.run.trial114.stdout:Package cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:01:33.589 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:33.590 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:33.590 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:33.611 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T13:01:33.920 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:02:58 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:34.003 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:34.004 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:34.004 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-20T13:01:34.004 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:34.004 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T13:01:34.004 INFO:teuthology.orchestra.run.trial114.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 149 k 2026-02-20T13:01:34.004 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:34.004 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T13:01:34.004 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:34.004 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-20T13:01:34.005 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:34.005 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 149 k 2026-02-20T13:01:34.005 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 455 k 2026-02-20T13:01:34.005 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T13:01:34.388 INFO:teuthology.orchestra.run.trial114.stdout:ceph-immutable-object-cache-20.3.0-5312.g26bc97 389 kB/s | 149 kB 00:00 2026-02-20T13:01:34.388 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:01:34.388 INFO:teuthology.orchestra.run.trial114.stdout:Total 389 kB/s | 149 kB 00:00 2026-02-20T13:01:34.388 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:01:34.392 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:01:34.392 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:01:34.423 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:01:34.423 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:01:34.478 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:01:34.480 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765. 1/1 2026-02-20T13:01:34.503 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765. 1/1 2026-02-20T13:01:34.503 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:01:34.503 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T13:01:34.503 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:34.813 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765. 1/1 2026-02-20T13:01:34.814 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:34.814 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:01:34.814 INFO:teuthology.orchestra.run.trial114.stdout: ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:34.814 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:34.814 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:34.841 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr 2026-02-20T13:01:35.148 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:00 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:35.212 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:35.230 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:35.231 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:35.231 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:35.253 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T13:01:35.563 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:00 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:35.627 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:01:35.646 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:35.646 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:35.647 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:35.668 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T13:01:35.974 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:00 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:36.039 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:01:36.058 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:36.058 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:36.059 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:36.080 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-rook 2026-02-20T13:01:36.385 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:01 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:36.450 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:01:36.468 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:36.468 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:36.469 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:36.490 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T13:01:36.803 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:01 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:36.868 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:01:36.886 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:36.886 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:36.887 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:36.908 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-osd 2026-02-20T13:01:37.216 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:02 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:37.281 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:37.299 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:37.300 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:37.300 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:37.323 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-osd-classic 2026-02-20T13:01:37.630 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:02 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:37.694 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:37.712 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:37.713 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:37.713 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:37.734 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-fuse 2026-02-20T13:01:38.038 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:03 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:38.121 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:38.122 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:38.122 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-20T13:01:38.122 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:38.122 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T13:01:38.122 INFO:teuthology.orchestra.run.trial114.stdout: ceph-fuse x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 914 k 2026-02-20T13:01:38.123 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:38.123 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T13:01:38.123 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:38.123 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-20T13:01:38.123 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:38.123 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 914 k 2026-02-20T13:01:38.123 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 2.9 M 2026-02-20T13:01:38.123 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T13:01:38.747 INFO:teuthology.orchestra.run.trial114.stdout:ceph-fuse-20.3.0-5312.g26bc9765.el9.x86_64.rpm 1.4 MB/s | 914 kB 00:00 2026-02-20T13:01:38.747 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:01:38.747 INFO:teuthology.orchestra.run.trial114.stdout:Total 1.4 MB/s | 914 kB 00:00 2026-02-20T13:01:38.747 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:01:38.752 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:01:38.752 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:01:38.785 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:01:38.785 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:01:38.879 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:01:38.897 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:39.109 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:39.165 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:39.165 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:39.166 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:01:39.166 INFO:teuthology.orchestra.run.trial114.stdout: ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:39.166 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:39.166 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:39.193 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-volume 2026-02-20T13:01:39.496 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:04 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:39.561 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:01:39.579 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:39.580 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:39.580 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:39.601 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados-devel 2026-02-20T13:01:39.908 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:04 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:39.991 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:39.991 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:39.991 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-20T13:01:39.991 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:39.991 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T13:01:39.991 INFO:teuthology.orchestra.run.trial114.stdout: librados-devel x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 124 k 2026-02-20T13:01:39.992 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:39.992 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T13:01:39.992 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:39.992 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-20T13:01:39.992 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:39.992 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 124 k 2026-02-20T13:01:39.992 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 434 k 2026-02-20T13:01:39.992 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T13:01:40.419 INFO:teuthology.orchestra.run.trial114.stdout:librados-devel-20.3.0-5312.g26bc9765.el9.x86_64 289 kB/s | 124 kB 00:00 2026-02-20T13:01:40.420 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:01:40.420 INFO:teuthology.orchestra.run.trial114.stdout:Total 288 kB/s | 124 kB 00:00 2026-02-20T13:01:40.420 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:01:40.423 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:01:40.423 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:01:40.454 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:01:40.455 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:01:40.509 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:01:40.526 INFO:teuthology.orchestra.run.trial114.stdout: Installing : librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:40.608 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:40.666 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:40.666 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:40.666 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:01:40.666 INFO:teuthology.orchestra.run.trial114.stdout: librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:40.666 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:40.666 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:40.694 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install libcephfs2 2026-02-20T13:01:41.002 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:05 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:41.067 INFO:teuthology.orchestra.run.trial114.stdout:Package libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:41.085 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:41.086 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:41.086 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:41.108 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install libcephfs-devel 2026-02-20T13:01:41.415 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:06 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:41.497 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:41.498 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:41.498 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-20T13:01:41.498 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:41.498 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T13:01:41.498 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-devel x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 37 k 2026-02-20T13:01:41.498 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:41.499 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T13:01:41.499 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:41.499 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-20T13:01:41.499 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:41.499 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 37 k 2026-02-20T13:01:41.499 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 171 k 2026-02-20T13:01:41.499 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T13:01:41.808 INFO:teuthology.orchestra.run.trial114.stdout:libcephfs-devel-20.3.0-5312.g26bc9765.el9.x86_6 121 kB/s | 37 kB 00:00 2026-02-20T13:01:41.808 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:01:41.808 INFO:teuthology.orchestra.run.trial114.stdout:Total 120 kB/s | 37 kB 00:00 2026-02-20T13:01:41.808 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:01:41.811 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:01:41.811 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:01:41.813 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:01:41.813 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:01:41.834 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:01:41.850 INFO:teuthology.orchestra.run.trial114.stdout: Installing : libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:41.911 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:41.968 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:41.968 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:41.969 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:01:41.969 INFO:teuthology.orchestra.run.trial114.stdout: libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:41.969 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:41.969 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:41.995 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados2 2026-02-20T13:01:42.304 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:07 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:42.368 INFO:teuthology.orchestra.run.trial114.stdout:Package librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:42.387 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:42.387 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:42.388 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:42.410 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librbd1 2026-02-20T13:01:42.720 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:07 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:42.784 INFO:teuthology.orchestra.run.trial114.stdout:Package librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:42.803 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:42.803 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:42.803 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:42.826 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rados 2026-02-20T13:01:43.133 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:08 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:43.197 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:43.216 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:43.216 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:43.217 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:43.239 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rgw 2026-02-20T13:01:43.547 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:08 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:43.612 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:43.631 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:43.631 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:43.631 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:43.653 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-cephfs 2026-02-20T13:01:43.961 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:08 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:44.025 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:44.043 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:44.044 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:44.044 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:44.066 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rbd 2026-02-20T13:01:44.375 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:09 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:44.440 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:44.458 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:44.459 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:44.459 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:44.481 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-fuse 2026-02-20T13:01:44.788 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:09 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:44.871 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:44.872 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:44.872 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-20T13:01:44.872 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:44.872 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T13:01:44.872 INFO:teuthology.orchestra.run.trial114.stdout: rbd-fuse x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 87 k 2026-02-20T13:01:44.873 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:44.873 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T13:01:44.873 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:44.873 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-20T13:01:44.873 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:44.873 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 87 k 2026-02-20T13:01:44.873 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 236 k 2026-02-20T13:01:44.873 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T13:01:45.219 INFO:teuthology.orchestra.run.trial114.stdout:rbd-fuse-20.3.0-5312.g26bc9765.el9.x86_64.rpm 249 kB/s | 87 kB 00:00 2026-02-20T13:01:45.220 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:01:45.220 INFO:teuthology.orchestra.run.trial114.stdout:Total 249 kB/s | 87 kB 00:00 2026-02-20T13:01:45.220 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:01:45.224 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:01:45.224 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:01:45.255 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:01:45.255 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:01:45.306 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:01:45.323 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:45.405 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:45.462 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:45.462 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:45.462 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:01:45.462 INFO:teuthology.orchestra.run.trial114.stdout: rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:45.463 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:45.463 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:45.493 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-mirror 2026-02-20T13:01:45.810 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:10 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:45.893 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:45.894 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:45.894 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout: rbd-mirror x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 2.6 M 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 2.6 M 2026-02-20T13:01:45.895 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 11 M 2026-02-20T13:01:45.896 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T13:01:46.648 INFO:teuthology.orchestra.run.trial114.stdout:rbd-mirror-20.3.0-5312.g26bc9765.el9.x86_64.rpm 3.4 MB/s | 2.6 MB 00:00 2026-02-20T13:01:46.648 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:01:46.648 INFO:teuthology.orchestra.run.trial114.stdout:Total 3.4 MB/s | 2.6 MB 00:00 2026-02-20T13:01:46.648 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:01:46.653 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:01:46.653 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:01:46.692 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:01:46.692 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:01:46.855 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:01:46.857 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:46.879 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:46.879 INFO:teuthology.orchestra.run.trial114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T13:01:46.880 INFO:teuthology.orchestra.run.trial114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T13:01:46.880 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:01:46.880 INFO:teuthology.orchestra.run.trial114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T13:01:46.880 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:47.173 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:47.173 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:47.173 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:01:47.173 INFO:teuthology.orchestra.run.trial114.stdout: rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:47.173 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:47.174 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:47.202 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-nbd 2026-02-20T13:01:47.519 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:12 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:47.603 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:47.603 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:47.604 INFO:teuthology.orchestra.run.trial114.stdout: Package Architecture Version Repository Size 2026-02-20T13:01:47.604 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:47.604 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T13:01:47.604 INFO:teuthology.orchestra.run.trial114.stdout: rbd-nbd x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 166 k 2026-02-20T13:01:47.604 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:47.604 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T13:01:47.604 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:47.604 INFO:teuthology.orchestra.run.trial114.stdout:Install 1 Package 2026-02-20T13:01:47.604 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:47.605 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 166 k 2026-02-20T13:01:47.605 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 496 k 2026-02-20T13:01:47.605 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T13:01:47.992 INFO:teuthology.orchestra.run.trial114.stdout:rbd-nbd-20.3.0-5312.g26bc9765.el9.x86_64.rpm 428 kB/s | 166 kB 00:00 2026-02-20T13:01:47.993 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:01:47.993 INFO:teuthology.orchestra.run.trial114.stdout:Total 427 kB/s | 166 kB 00:00 2026-02-20T13:01:47.993 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:01:47.998 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:01:47.998 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:01:48.029 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:01:48.029 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:01:48.085 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:01:48.102 INFO:teuthology.orchestra.run.trial114.stdout: Installing : rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:48.185 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:48.242 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 1/1 2026-02-20T13:01:48.242 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:48.242 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:01:48.243 INFO:teuthology.orchestra.run.trial114.stdout: rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:01:48.243 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:48.243 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:48.272 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-osd-crimson 2026-02-20T13:01:48.596 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:13 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:48.659 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-osd-crimson-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:01:48.678 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:48.679 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:01:48.679 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:01:48.702 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T13:01:49.012 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:03:14 ago on Fri 20 Feb 2026 12:58:35 PM UTC. 2026-02-20T13:01:49.096 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:01:49.096 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout: Package Arch Version Repo Size 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout:Installing: 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 425 M 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout:Installing weak dependencies: 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout: ceph-debugsource x86_64 2:20.3.0-5312.g26bc9765.el9 ceph 12 M 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout:Transaction Summary 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout:================================================================================ 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout:Install 2 Packages 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout:Total download size: 437 M 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout:Installed size: 2.6 G 2026-02-20T13:01:49.097 INFO:teuthology.orchestra.run.trial114.stdout:Downloading Packages: 2026-02-20T13:01:50.019 INFO:teuthology.orchestra.run.trial185.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5312.g 6.0 MB/s | 425 MB 01:11 2026-02-20T13:01:50.020 INFO:teuthology.orchestra.run.trial185.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:01:50.020 INFO:teuthology.orchestra.run.trial185.stdout:Total 6.1 MB/s | 437 MB 01:11 2026-02-20T13:01:50.020 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction check 2026-02-20T13:01:50.026 INFO:teuthology.orchestra.run.trial185.stdout:Transaction check succeeded. 2026-02-20T13:01:50.026 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction test 2026-02-20T13:01:50.951 INFO:teuthology.orchestra.run.trial114.stdout:(1/2): ceph-debugsource-20.3.0-5312.g26bc9765.e 6.5 MB/s | 12 MB 00:01 2026-02-20T13:01:51.374 INFO:teuthology.orchestra.run.trial185.stdout:Transaction test succeeded. 2026-02-20T13:01:51.374 INFO:teuthology.orchestra.run.trial185.stdout:Running transaction 2026-02-20T13:01:54.938 INFO:teuthology.orchestra.run.trial185.stdout: Preparing : 1/1 2026-02-20T13:02:05.007 INFO:teuthology.orchestra.run.trial114.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5312.g 27 MB/s | 425 MB 00:15 2026-02-20T13:02:05.008 INFO:teuthology.orchestra.run.trial114.stdout:-------------------------------------------------------------------------------- 2026-02-20T13:02:05.009 INFO:teuthology.orchestra.run.trial114.stdout:Total 27 MB/s | 437 MB 00:15 2026-02-20T13:02:05.009 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction check 2026-02-20T13:02:05.013 INFO:teuthology.orchestra.run.trial114.stdout:Transaction check succeeded. 2026-02-20T13:02:05.014 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction test 2026-02-20T13:02:06.362 INFO:teuthology.orchestra.run.trial114.stdout:Transaction test succeeded. 2026-02-20T13:02:06.363 INFO:teuthology.orchestra.run.trial114.stdout:Running transaction 2026-02-20T13:02:09.952 INFO:teuthology.orchestra.run.trial114.stdout: Preparing : 1/1 2026-02-20T13:02:16.687 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-debugsource-2:20.3.0-5312.g26bc9765.el9.x86_64 1/2 2026-02-20T13:02:16.706 INFO:teuthology.orchestra.run.trial185.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.e 2/2 2026-02-20T13:02:18.512 INFO:teuthology.orchestra.run.trial185.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.e 2/2 2026-02-20T13:02:18.512 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-debugsource-2:20.3.0-5312.g26bc9765.el9.x86_64 1/2 2026-02-20T13:02:18.570 INFO:teuthology.orchestra.run.trial185.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.e 2/2 2026-02-20T13:02:18.570 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:02:18.571 INFO:teuthology.orchestra.run.trial185.stdout:Installed: 2026-02-20T13:02:18.571 INFO:teuthology.orchestra.run.trial185.stdout: ceph-debugsource-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:02:18.571 INFO:teuthology.orchestra.run.trial185.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:02:18.571 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:02:18.571 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:02:18.642 DEBUG:teuthology.parallel:result is None 2026-02-20T13:02:31.748 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-debugsource-2:20.3.0-5312.g26bc9765.el9.x86_64 1/2 2026-02-20T13:02:31.765 INFO:teuthology.orchestra.run.trial114.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.e 2/2 2026-02-20T13:02:33.715 INFO:teuthology.orchestra.run.trial114.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.e 2/2 2026-02-20T13:02:33.715 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-debugsource-2:20.3.0-5312.g26bc9765.el9.x86_64 1/2 2026-02-20T13:02:33.774 INFO:teuthology.orchestra.run.trial114.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.e 2/2 2026-02-20T13:02:33.774 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:02:33.774 INFO:teuthology.orchestra.run.trial114.stdout:Installed: 2026-02-20T13:02:33.774 INFO:teuthology.orchestra.run.trial114.stdout: ceph-debugsource-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:02:33.774 INFO:teuthology.orchestra.run.trial114.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5312.g26bc9765.el9.x86_64 2026-02-20T13:02:33.774 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:02:33.774 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:02:33.847 DEBUG:teuthology.parallel:result is None 2026-02-20T13:02:33.848 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T13:02:34.015 DEBUG:teuthology.orchestra.run.trial114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T13:02:34.035 INFO:teuthology.orchestra.run.trial114.stdout:20.3.0-5312.g26bc9765.el9 2026-02-20T13:02:34.036 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5312.g26bc9765.el9 2026-02-20T13:02:34.036 INFO:teuthology.task.install:The correct ceph version 20.3.0-5312.g26bc9765 is installed. 2026-02-20T13:02:34.038 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T13:02:34.179 DEBUG:teuthology.orchestra.run.trial185:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T13:02:34.199 INFO:teuthology.orchestra.run.trial185.stdout:20.3.0-5312.g26bc9765.el9 2026-02-20T13:02:34.200 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5312.g26bc9765.el9 2026-02-20T13:02:34.200 INFO:teuthology.task.install:The correct ceph version 20.3.0-5312.g26bc9765 is installed. 2026-02-20T13:02:34.201 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T13:02:34.201 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:02:34.202 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T13:02:34.227 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:02:34.227 DEBUG:teuthology.orchestra.run.trial185:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T13:02:34.265 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T13:02:34.266 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:02:34.266 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T13:02:34.292 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T13:02:34.357 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:02:34.357 DEBUG:teuthology.orchestra.run.trial185:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T13:02:34.382 DEBUG:teuthology.orchestra.run.trial185:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T13:02:34.446 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T13:02:34.447 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:02:34.447 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T13:02:34.473 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T13:02:34.539 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:02:34.539 DEBUG:teuthology.orchestra.run.trial185:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T13:02:34.564 DEBUG:teuthology.orchestra.run.trial185:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T13:02:34.629 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T13:02:34.629 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:02:34.630 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T13:02:34.654 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T13:02:34.718 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:02:34.719 DEBUG:teuthology.orchestra.run.trial185:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T13:02:34.744 DEBUG:teuthology.orchestra.run.trial185:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T13:02:34.808 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T13:02:34.827 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T13:02:34.828 DEBUG:teuthology.orchestra.run.trial114:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T13:02:34.828 DEBUG:teuthology.orchestra.run.trial185:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T13:02:34.831 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial114.front.sepia.ceph.com 2026-02-20T13:02:34.832 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T13:02:34.850 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial185.front.sepia.ceph.com 2026-02-20T13:02:34.850 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T13:02:34.881 DEBUG:teuthology.parallel:result is None 2026-02-20T13:02:34.900 DEBUG:teuthology.parallel:result is None 2026-02-20T13:02:34.900 INFO:teuthology.run_tasks:Running task install... 2026-02-20T13:02:34.918 DEBUG:teuthology.task.install:project ceph 2026-02-20T13:02:34.918 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}} 2026-02-20T13:02:34.918 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'} 2026-02-20T13:02:34.918 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T13:02:34.921 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T13:02:34.921 INFO:teuthology.task.install:extra packages: [] 2026-02-20T13:02:34.921 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'tag': None, 'wait_for_package': False} 2026-02-20T13:02:34.921 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T13:02:34.922 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'tag': None, 'wait_for_package': False} 2026-02-20T13:02:34.922 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T13:02:35.073 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/ 2026-02-20T13:02:35.073 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5312.g26bc9765 2026-02-20T13:02:35.084 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/ 2026-02-20T13:02:35.084 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5312.g26bc9765 2026-02-20T13:02:35.303 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T13:02:35.304 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:02:35.304 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T13:02:35.328 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T13:02:35.328 DEBUG:teuthology.orchestra.run.trial114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/26bc97655ae0056b78c14ab91d1307332bd6dfca/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T13:02:35.340 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-12-02-2026-PR66245/26bc97655ae0056b78c14ab91d1307332bd6dfca/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T13:02:35.340 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:02:35.340 DEBUG:teuthology.orchestra.run.trial185:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T13:02:35.364 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T13:02:35.364 DEBUG:teuthology.orchestra.run.trial185:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/26bc97655ae0056b78c14ab91d1307332bd6dfca/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T13:02:35.393 DEBUG:teuthology.orchestra.run.trial114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T13:02:35.429 DEBUG:teuthology.orchestra.run.trial185:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T13:02:35.458 DEBUG:teuthology.orchestra.run.trial114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T13:02:35.494 DEBUG:teuthology.orchestra.run.trial185:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T13:02:35.513 INFO:teuthology.orchestra.run.trial114.stdout:check_obsoletes = 1 2026-02-20T13:02:35.523 DEBUG:teuthology.orchestra.run.trial114:> sudo yum clean all 2026-02-20T13:02:35.550 INFO:teuthology.orchestra.run.trial185.stdout:check_obsoletes = 1 2026-02-20T13:02:35.560 DEBUG:teuthology.orchestra.run.trial185:> sudo yum clean all 2026-02-20T13:02:35.683 INFO:teuthology.orchestra.run.trial114.stdout:56 files removed 2026-02-20T13:02:35.698 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-radosgw 2026-02-20T13:02:35.722 INFO:teuthology.orchestra.run.trial185.stdout:56 files removed 2026-02-20T13:02:35.737 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-radosgw 2026-02-20T13:02:36.268 INFO:teuthology.orchestra.run.trial114.stdout:ceph packages for x86_64 223 kB/s | 94 kB 00:00 2026-02-20T13:02:36.308 INFO:teuthology.orchestra.run.trial185.stdout:ceph packages for x86_64 222 kB/s | 94 kB 00:00 2026-02-20T13:02:36.692 INFO:teuthology.orchestra.run.trial114.stdout:ceph noarch packages 61 kB/s | 24 kB 00:00 2026-02-20T13:02:36.736 INFO:teuthology.orchestra.run.trial185.stdout:ceph noarch packages 61 kB/s | 24 kB 00:00 2026-02-20T13:02:37.084 INFO:teuthology.orchestra.run.trial114.stdout:ceph source packages 5.6 kB/s | 2.1 kB 00:00 2026-02-20T13:02:37.133 INFO:teuthology.orchestra.run.trial185.stdout:ceph source packages 5.5 kB/s | 2.1 kB 00:00 2026-02-20T13:02:43.152 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 8.9 MB 00:06 2026-02-20T13:02:45.482 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-20T13:02:48.136 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-20T13:02:58.998 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - CRB 936 kB/s | 7.8 MB 00:08 2026-02-20T13:03:01.014 INFO:teuthology.orchestra.run.trial185.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-20T13:03:07.410 INFO:teuthology.orchestra.run.trial185.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 20 MB 00:06 2026-02-20T13:03:10.439 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:26 2026-02-20T13:03:10.554 INFO:teuthology.orchestra.run.trial185.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-20T13:03:11.733 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:11.752 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:11.753 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:11.753 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:11.776 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-test 2026-02-20T13:03:12.089 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:12.154 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:12.173 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:12.174 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:12.175 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:12.196 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph 2026-02-20T13:03:12.509 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:12.575 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:12.593 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:12.594 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:12.594 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:12.615 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-base 2026-02-20T13:03:12.932 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:12.998 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:13.017 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:13.018 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:13.018 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:13.039 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install cephadm 2026-02-20T13:03:13.350 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:13.416 INFO:teuthology.orchestra.run.trial185.stdout:Package cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:13.435 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:13.436 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:13.436 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:13.458 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T13:03:13.706 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 7.8 MB 00:00 2026-02-20T13:03:13.773 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:13.838 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:13.856 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:13.857 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:13.857 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:13.878 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr 2026-02-20T13:03:14.187 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:14.251 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:14.270 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:14.271 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:14.271 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:14.291 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T13:03:14.605 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:14.671 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:14.690 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:14.691 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:14.691 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:14.714 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T13:03:15.025 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:15.090 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:15.109 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:15.110 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:15.110 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:15.132 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr-rook 2026-02-20T13:03:15.436 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:15.503 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:15.522 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:15.523 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:15.523 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:15.544 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T13:03:15.856 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:15.922 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:15.941 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:15.942 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:15.942 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:15.966 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-osd 2026-02-20T13:03:16.281 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:16.347 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:16.366 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:16.367 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:16.367 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:16.389 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-osd-classic 2026-02-20T13:03:16.698 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:16.763 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:16.782 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:16.783 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:16.783 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:16.804 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-fuse 2026-02-20T13:03:17.118 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:17.185 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:17.204 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:17.204 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:17.205 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:17.227 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install ceph-volume 2026-02-20T13:03:17.542 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:17.608 INFO:teuthology.orchestra.run.trial185.stdout:Package ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:17.627 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:17.628 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:17.628 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:17.650 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install librados-devel 2026-02-20T13:03:17.962 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:18.028 INFO:teuthology.orchestra.run.trial185.stdout:Package librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:18.047 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:18.047 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:18.048 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:18.068 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install libcephfs2 2026-02-20T13:03:18.383 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:18.448 INFO:teuthology.orchestra.run.trial185.stdout:Package libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:18.467 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:18.468 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:18.468 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:18.489 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install libcephfs-devel 2026-02-20T13:03:18.800 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:18.866 INFO:teuthology.orchestra.run.trial185.stdout:Package libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:18.885 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:18.886 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:18.886 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:18.907 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install librados2 2026-02-20T13:03:19.221 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:19.286 INFO:teuthology.orchestra.run.trial185.stdout:Package librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:19.304 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:19.305 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:19.305 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:19.326 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install librbd1 2026-02-20T13:03:19.641 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:19.707 INFO:teuthology.orchestra.run.trial185.stdout:Package librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:19.726 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:19.726 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:19.726 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:19.749 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install python3-rados 2026-02-20T13:03:19.932 INFO:teuthology.orchestra.run.trial114.stdout:CentOS Stream 9 - Extras packages 3.7 kB/s | 20 kB 00:05 2026-02-20T13:03:20.061 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:20.126 INFO:teuthology.orchestra.run.trial185.stdout:Package python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:20.144 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:20.145 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:20.145 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:20.166 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install python3-rgw 2026-02-20T13:03:20.477 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:20.542 INFO:teuthology.orchestra.run.trial185.stdout:Package python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:20.561 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:20.561 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:20.562 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:20.584 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install python3-cephfs 2026-02-20T13:03:20.894 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:20.960 INFO:teuthology.orchestra.run.trial185.stdout:Package python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:20.978 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:20.979 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:20.979 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:21.000 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install python3-rbd 2026-02-20T13:03:21.319 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:21.385 INFO:teuthology.orchestra.run.trial185.stdout:Package python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:21.404 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:21.404 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:21.405 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:21.426 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install rbd-fuse 2026-02-20T13:03:21.738 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:21.806 INFO:teuthology.orchestra.run.trial185.stdout:Package rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:21.825 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:21.825 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:21.825 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:21.849 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install rbd-mirror 2026-02-20T13:03:22.161 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:22.226 INFO:teuthology.orchestra.run.trial185.stdout:Package rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:22.245 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:22.246 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:22.246 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:22.268 DEBUG:teuthology.orchestra.run.trial185:> sudo yum -y install rbd-nbd 2026-02-20T13:03:22.580 INFO:teuthology.orchestra.run.trial185.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 01:03:10 PM UTC. 2026-02-20T13:03:22.647 INFO:teuthology.orchestra.run.trial185.stdout:Package rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:22.666 INFO:teuthology.orchestra.run.trial185.stdout:Dependencies resolved. 2026-02-20T13:03:22.667 INFO:teuthology.orchestra.run.trial185.stdout:Nothing to do. 2026-02-20T13:03:22.667 INFO:teuthology.orchestra.run.trial185.stdout:Complete! 2026-02-20T13:03:22.695 DEBUG:teuthology.parallel:result is None 2026-02-20T13:03:25.865 INFO:teuthology.orchestra.run.trial114.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 20 MB 00:05 2026-02-20T13:03:29.160 INFO:teuthology.orchestra.run.trial114.stdout:lab-extras 329 kB/s | 50 kB 00:00 2026-02-20T13:03:30.345 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-radosgw-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:30.364 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:30.364 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:30.365 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:30.388 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-test 2026-02-20T13:03:30.704 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:30.769 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-test-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:30.788 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:30.788 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:30.788 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:30.812 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph 2026-02-20T13:03:31.119 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:31.183 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:31.202 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:31.202 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:31.203 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:31.225 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-base 2026-02-20T13:03:31.535 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:31.600 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-base-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:31.619 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:31.619 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:31.619 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:31.642 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install cephadm 2026-02-20T13:03:31.951 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:32.016 INFO:teuthology.orchestra.run.trial114.stdout:Package cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:32.034 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:32.035 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:32.035 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:32.058 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T13:03:32.366 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:32.431 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-immutable-object-cache-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:32.449 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:32.450 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:32.450 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:32.472 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr 2026-02-20T13:03:32.783 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:32.848 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:32.867 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:32.868 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:32.868 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:32.890 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T13:03:33.205 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:33.269 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-dashboard-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:33.289 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:33.290 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:33.290 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:33.311 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T13:03:33.622 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:33.686 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:33.704 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:33.705 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:33.705 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:33.727 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-rook 2026-02-20T13:03:34.037 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:34.102 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-rook-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:34.121 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:34.122 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:34.122 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:34.142 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T13:03:34.451 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:34.515 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-mgr-cephadm-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:34.534 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:34.535 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:34.535 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:34.558 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-osd 2026-02-20T13:03:34.870 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:34.935 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-osd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:34.953 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:34.954 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:34.954 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:34.977 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-osd-classic 2026-02-20T13:03:35.291 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:35.355 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-osd-classic-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:35.374 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:35.374 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:35.374 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:35.396 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-fuse 2026-02-20T13:03:35.706 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:35.771 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:35.790 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:35.790 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:35.790 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:35.813 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install ceph-volume 2026-02-20T13:03:36.121 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:36.186 INFO:teuthology.orchestra.run.trial114.stdout:Package ceph-volume-2:20.3.0-5312.g26bc9765.el9.noarch is already installed. 2026-02-20T13:03:36.205 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:36.205 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:36.205 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:36.228 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados-devel 2026-02-20T13:03:36.541 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:36.605 INFO:teuthology.orchestra.run.trial114.stdout:Package librados-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:36.624 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:36.624 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:36.624 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:36.646 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install libcephfs2 2026-02-20T13:03:36.951 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:37.017 INFO:teuthology.orchestra.run.trial114.stdout:Package libcephfs2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:37.035 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:37.036 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:37.036 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:37.058 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install libcephfs-devel 2026-02-20T13:03:37.374 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:37.438 INFO:teuthology.orchestra.run.trial114.stdout:Package libcephfs-devel-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:37.457 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:37.458 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:37.458 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:37.480 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librados2 2026-02-20T13:03:37.791 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:37.856 INFO:teuthology.orchestra.run.trial114.stdout:Package librados2-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:37.875 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:37.876 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:37.876 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:37.897 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install librbd1 2026-02-20T13:03:38.208 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:38.274 INFO:teuthology.orchestra.run.trial114.stdout:Package librbd1-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:38.292 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:38.293 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:38.293 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:38.315 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rados 2026-02-20T13:03:38.625 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:38.690 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rados-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:38.709 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:38.709 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:38.709 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:38.731 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rgw 2026-02-20T13:03:39.038 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:39.103 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rgw-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:39.122 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:39.123 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:39.123 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:39.144 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-cephfs 2026-02-20T13:03:39.458 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:39.523 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-cephfs-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:39.541 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:39.542 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:39.542 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:39.564 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install python3-rbd 2026-02-20T13:03:39.874 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:39.941 INFO:teuthology.orchestra.run.trial114.stdout:Package python3-rbd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:39.959 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:39.960 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:39.960 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:39.982 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-fuse 2026-02-20T13:03:40.291 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:40.356 INFO:teuthology.orchestra.run.trial114.stdout:Package rbd-fuse-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:40.375 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:40.375 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:40.376 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:40.398 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-mirror 2026-02-20T13:03:40.707 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:40.772 INFO:teuthology.orchestra.run.trial114.stdout:Package rbd-mirror-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:40.791 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:40.792 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:40.792 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:40.814 DEBUG:teuthology.orchestra.run.trial114:> sudo yum -y install rbd-nbd 2026-02-20T13:03:41.130 INFO:teuthology.orchestra.run.trial114.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 01:03:29 PM UTC. 2026-02-20T13:03:41.196 INFO:teuthology.orchestra.run.trial114.stdout:Package rbd-nbd-2:20.3.0-5312.g26bc9765.el9.x86_64 is already installed. 2026-02-20T13:03:41.214 INFO:teuthology.orchestra.run.trial114.stdout:Dependencies resolved. 2026-02-20T13:03:41.215 INFO:teuthology.orchestra.run.trial114.stdout:Nothing to do. 2026-02-20T13:03:41.215 INFO:teuthology.orchestra.run.trial114.stdout:Complete! 2026-02-20T13:03:41.241 DEBUG:teuthology.parallel:result is None 2026-02-20T13:03:41.242 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T13:03:41.405 DEBUG:teuthology.orchestra.run.trial114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T13:03:41.426 INFO:teuthology.orchestra.run.trial114.stdout:20.3.0-5312.g26bc9765.el9 2026-02-20T13:03:41.426 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5312.g26bc9765.el9 2026-02-20T13:03:41.426 INFO:teuthology.task.install:The correct ceph version 20.3.0-5312.g26bc9765 is installed. 2026-02-20T13:03:41.429 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=26bc97655ae0056b78c14ab91d1307332bd6dfca 2026-02-20T13:03:41.576 DEBUG:teuthology.orchestra.run.trial185:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T13:03:41.597 INFO:teuthology.orchestra.run.trial185.stdout:20.3.0-5312.g26bc9765.el9 2026-02-20T13:03:41.597 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5312.g26bc9765.el9 2026-02-20T13:03:41.597 INFO:teuthology.task.install:The correct ceph version 20.3.0-5312.g26bc9765 is installed. 2026-02-20T13:03:41.599 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-20T13:03:41.599 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T13:03:41.682 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T13:03:41.683 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod 777 /var/log/ceph 2026-02-20T13:03:41.684 DEBUG:teuthology.orchestra.run.trial185:> sudo chmod 777 /var/log/ceph 2026-02-20T13:03:41.710 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T13:03:41.710 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T13:03:41.749 DEBUG:teuthology.orchestra.run.trial185:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T13:03:41.773 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T13:03:41.773 DEBUG:teuthology.orchestra.run.trial114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T13:03:41.812 DEBUG:teuthology.orchestra.run.trial185:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T13:03:41.849 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T13:03:41.849 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T13:03:41.849 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756', 'branch': 'wip-perezjos-crimson-only-12-02-2026-PR66245', 'description': 'crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '60756', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-perezjos-crimson-only-12-02-2026-PR66245'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}}, 'owner': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5547, 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '445d5c9ba18a4040e70e25303230c36c77773acb', 'targets': {'trial114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJgyGgOnOYczbY0a1a6OyEBNAD214MS9z5OF8DTarvT+H80Rcp4DACC4r2LezvncOhpDIxV+O5JlNRZuRIuAHxo=', 'trial185.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4PjeTapQJzwPJ4pIxg1v4d4QX81B+6d7J0vOqgh947B0+WqtvMMNbLDGVijoHfDCL3c2UC8PUvfQs9Qh6SVXQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'rados': {'balance_reads': True, 'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 0, 'delete': 50, 'read': 100, 'rollback': 0, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-20_10:29:19', 'tube': 'trial', 'user': 'jjperez', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T13:03:41.849 DEBUG:teuthology.orchestra.run.trial114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T13:03:41.875 DEBUG:teuthology.orchestra.run.trial185:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T13:03:41.894 DEBUG:teuthology.orchestra.run.trial114:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T13:03:41.931 DEBUG:teuthology.orchestra.run.trial185:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T13:03:41.959 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:03:41.959 DEBUG:teuthology.orchestra.run.trial114:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T13:03:42.009 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T13:03:42.009 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_1 2026-02-20T13:03:42.067 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T13:03:42.067 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:03:42.067 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-20T13:03:42.067 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:03:42.067 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:03:42.067 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-20 13:01:47.016922098 +0000 2026-02-20T13:03:42.068 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-20 12:58:56.012249002 +0000 2026-02-20T13:03:42.068 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-20 12:58:56.012249002 +0000 2026-02-20T13:03:42.068 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-20 12:58:56.012249002 +0000 2026-02-20T13:03:42.068 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T13:03:42.129 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-20T13:03:42.130 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-20T13:03:42.130 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000228235 s, 2.2 MB/s 2026-02-20T13:03:42.131 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T13:03:42.188 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_2 2026-02-20T13:03:42.244 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T13:03:42.244 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:03:42.244 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-20T13:03:42.244 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:03:42.244 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:03:42.244 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-20 13:01:47.017922068 +0000 2026-02-20T13:03:42.244 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-20 12:58:56.012249002 +0000 2026-02-20T13:03:42.244 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-20 12:58:56.012249002 +0000 2026-02-20T13:03:42.244 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-20 12:58:56.012249002 +0000 2026-02-20T13:03:42.244 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T13:03:42.305 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-20T13:03:42.306 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-20T13:03:42.306 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000210963 s, 2.4 MB/s 2026-02-20T13:03:42.307 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T13:03:42.363 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_3 2026-02-20T13:03:42.418 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T13:03:42.418 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:03:42.418 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-20T13:03:42.418 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:03:42.418 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:03:42.418 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-20 13:01:47.017922068 +0000 2026-02-20T13:03:42.418 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-20 12:58:56.011249044 +0000 2026-02-20T13:03:42.418 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-20 12:58:56.011249044 +0000 2026-02-20T13:03:42.418 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-20 12:58:56.011249044 +0000 2026-02-20T13:03:42.418 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T13:03:42.479 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-20T13:03:42.479 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-20T13:03:42.479 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000145551 s, 3.5 MB/s 2026-02-20T13:03:42.480 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T13:03:42.538 DEBUG:teuthology.orchestra.run.trial114:> stat /dev/vg_nvme/lv_4 2026-02-20T13:03:42.594 INFO:teuthology.orchestra.run.trial114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T13:03:42.594 INFO:teuthology.orchestra.run.trial114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:03:42.594 INFO:teuthology.orchestra.run.trial114.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-20T13:03:42.594 INFO:teuthology.orchestra.run.trial114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:03:42.594 INFO:teuthology.orchestra.run.trial114.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:03:42.594 INFO:teuthology.orchestra.run.trial114.stdout:Access: 2026-02-20 13:01:47.017922068 +0000 2026-02-20T13:03:42.595 INFO:teuthology.orchestra.run.trial114.stdout:Modify: 2026-02-20 12:58:56.010249088 +0000 2026-02-20T13:03:42.595 INFO:teuthology.orchestra.run.trial114.stdout:Change: 2026-02-20 12:58:56.010249088 +0000 2026-02-20T13:03:42.595 INFO:teuthology.orchestra.run.trial114.stdout: Birth: 2026-02-20 12:58:56.010249088 +0000 2026-02-20T13:03:42.595 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T13:03:42.657 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records in 2026-02-20T13:03:42.657 INFO:teuthology.orchestra.run.trial114.stderr:1+0 records out 2026-02-20T13:03:42.658 INFO:teuthology.orchestra.run.trial114.stderr:512 bytes copied, 0.000142996 s, 3.6 MB/s 2026-02-20T13:03:42.659 DEBUG:teuthology.orchestra.run.trial114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T13:03:42.715 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T13:03:42.715 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:03:42.715 DEBUG:teuthology.orchestra.run.trial185:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T13:03:42.733 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T13:03:42.733 DEBUG:teuthology.orchestra.run.trial185:> stat /dev/vg_nvme/lv_1 2026-02-20T13:03:42.789 INFO:teuthology.orchestra.run.trial185.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T13:03:42.789 INFO:teuthology.orchestra.run.trial185.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:03:42.789 INFO:teuthology.orchestra.run.trial185.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-20T13:03:42.789 INFO:teuthology.orchestra.run.trial185.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:03:42.790 INFO:teuthology.orchestra.run.trial185.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:03:42.790 INFO:teuthology.orchestra.run.trial185.stdout:Access: 2026-02-20 13:00:36.546848724 +0000 2026-02-20T13:03:42.790 INFO:teuthology.orchestra.run.trial185.stdout:Modify: 2026-02-20 12:58:05.334992572 +0000 2026-02-20T13:03:42.790 INFO:teuthology.orchestra.run.trial185.stdout:Change: 2026-02-20 12:58:05.334992572 +0000 2026-02-20T13:03:42.790 INFO:teuthology.orchestra.run.trial185.stdout: Birth: 2026-02-20 12:58:05.334992572 +0000 2026-02-20T13:03:42.790 DEBUG:teuthology.orchestra.run.trial185:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T13:03:42.852 INFO:teuthology.orchestra.run.trial185.stderr:1+0 records in 2026-02-20T13:03:42.852 INFO:teuthology.orchestra.run.trial185.stderr:1+0 records out 2026-02-20T13:03:42.853 INFO:teuthology.orchestra.run.trial185.stderr:512 bytes copied, 0.000171731 s, 3.0 MB/s 2026-02-20T13:03:42.855 DEBUG:teuthology.orchestra.run.trial185:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T13:03:42.914 DEBUG:teuthology.orchestra.run.trial185:> stat /dev/vg_nvme/lv_2 2026-02-20T13:03:42.971 INFO:teuthology.orchestra.run.trial185.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T13:03:42.971 INFO:teuthology.orchestra.run.trial185.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:03:42.971 INFO:teuthology.orchestra.run.trial185.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-20T13:03:42.971 INFO:teuthology.orchestra.run.trial185.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:03:42.972 INFO:teuthology.orchestra.run.trial185.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:03:42.972 INFO:teuthology.orchestra.run.trial185.stdout:Access: 2026-02-20 13:00:36.547848723 +0000 2026-02-20T13:03:42.972 INFO:teuthology.orchestra.run.trial185.stdout:Modify: 2026-02-20 12:58:05.334992572 +0000 2026-02-20T13:03:42.972 INFO:teuthology.orchestra.run.trial185.stdout:Change: 2026-02-20 12:58:05.334992572 +0000 2026-02-20T13:03:42.972 INFO:teuthology.orchestra.run.trial185.stdout: Birth: 2026-02-20 12:58:05.334992572 +0000 2026-02-20T13:03:42.972 DEBUG:teuthology.orchestra.run.trial185:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T13:03:43.033 INFO:teuthology.orchestra.run.trial185.stderr:1+0 records in 2026-02-20T13:03:43.033 INFO:teuthology.orchestra.run.trial185.stderr:1+0 records out 2026-02-20T13:03:43.033 INFO:teuthology.orchestra.run.trial185.stderr:512 bytes copied, 0.000181049 s, 2.8 MB/s 2026-02-20T13:03:43.034 DEBUG:teuthology.orchestra.run.trial185:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T13:03:43.091 DEBUG:teuthology.orchestra.run.trial185:> stat /dev/vg_nvme/lv_3 2026-02-20T13:03:43.148 INFO:teuthology.orchestra.run.trial185.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T13:03:43.148 INFO:teuthology.orchestra.run.trial185.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:03:43.148 INFO:teuthology.orchestra.run.trial185.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-20T13:03:43.149 INFO:teuthology.orchestra.run.trial185.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:03:43.149 INFO:teuthology.orchestra.run.trial185.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:03:43.149 INFO:teuthology.orchestra.run.trial185.stdout:Access: 2026-02-20 13:00:36.547848723 +0000 2026-02-20T13:03:43.149 INFO:teuthology.orchestra.run.trial185.stdout:Modify: 2026-02-20 12:58:05.334992572 +0000 2026-02-20T13:03:43.149 INFO:teuthology.orchestra.run.trial185.stdout:Change: 2026-02-20 12:58:05.334992572 +0000 2026-02-20T13:03:43.149 INFO:teuthology.orchestra.run.trial185.stdout: Birth: 2026-02-20 12:58:05.334992572 +0000 2026-02-20T13:03:43.150 DEBUG:teuthology.orchestra.run.trial185:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T13:03:43.211 INFO:teuthology.orchestra.run.trial185.stderr:1+0 records in 2026-02-20T13:03:43.211 INFO:teuthology.orchestra.run.trial185.stderr:1+0 records out 2026-02-20T13:03:43.211 INFO:teuthology.orchestra.run.trial185.stderr:512 bytes copied, 0.000156863 s, 3.3 MB/s 2026-02-20T13:03:43.212 DEBUG:teuthology.orchestra.run.trial185:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T13:03:43.269 DEBUG:teuthology.orchestra.run.trial185:> stat /dev/vg_nvme/lv_4 2026-02-20T13:03:43.325 INFO:teuthology.orchestra.run.trial185.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T13:03:43.325 INFO:teuthology.orchestra.run.trial185.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T13:03:43.325 INFO:teuthology.orchestra.run.trial185.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-20T13:03:43.325 INFO:teuthology.orchestra.run.trial185.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T13:03:43.325 INFO:teuthology.orchestra.run.trial185.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T13:03:43.325 INFO:teuthology.orchestra.run.trial185.stdout:Access: 2026-02-20 13:00:36.547848723 +0000 2026-02-20T13:03:43.325 INFO:teuthology.orchestra.run.trial185.stdout:Modify: 2026-02-20 12:58:05.333992589 +0000 2026-02-20T13:03:43.325 INFO:teuthology.orchestra.run.trial185.stdout:Change: 2026-02-20 12:58:05.333992589 +0000 2026-02-20T13:03:43.325 INFO:teuthology.orchestra.run.trial185.stdout: Birth: 2026-02-20 12:58:05.333992589 +0000 2026-02-20T13:03:43.325 DEBUG:teuthology.orchestra.run.trial185:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T13:03:43.389 INFO:teuthology.orchestra.run.trial185.stderr:1+0 records in 2026-02-20T13:03:43.390 INFO:teuthology.orchestra.run.trial185.stderr:1+0 records out 2026-02-20T13:03:43.390 INFO:teuthology.orchestra.run.trial185.stderr:512 bytes copied, 0.000136876 s, 3.7 MB/s 2026-02-20T13:03:43.391 DEBUG:teuthology.orchestra.run.trial185:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T13:03:43.448 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T13:03:43.449 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial185.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T13:03:43.449 INFO:tasks.ceph:Generating config... 2026-02-20T13:03:43.451 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-20T13:03:43.451 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-20T13:03:43.451 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-20T13:03:43.452 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] osd delete sleep = 1 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] osd max backfills = 3 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2026-02-20T13:03:43.453 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2026-02-20T13:03:43.454 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-20T13:03:43.454 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2026-02-20T13:03:43.454 INFO:tasks.ceph:[osd] osd target transaction size = 5 2026-02-20T13:03:43.454 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-20T13:03:43.454 INFO:tasks.ceph:[osd] seastore cachepin type = 2Q 2026-02-20T13:03:43.454 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-20T13:03:43.454 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-20T13:03:43.454 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-20T13:03:43.454 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-20T13:03:43.454 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-20T13:03:43.454 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-20T13:03:43.454 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-20T13:03:43.455 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-20T13:03:43.455 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2026-02-20T13:03:43.455 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-20T13:03:43.455 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-20T13:03:43.456 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-20T13:03:43.456 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T13:03:43.456 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T13:03:43.498 INFO:teuthology.orchestra.run.trial114.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T13:03:43.501 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T13:03:43.585 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T13:03:43.648 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.114')] 2026-02-20T13:03:43.649 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.114', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-20T13:03:43.650 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:03:43.650 DEBUG:teuthology.orchestra.run.trial114:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T13:03:43.705 DEBUG:teuthology.orchestra.run.trial114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.114 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T13:03:43.784 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:03:43.781+0000 7fa22e843f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:03:43.784 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:03:43.781+0000 7fa22e843f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:03:43.784 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:03:43.781+0000 7fa22e843f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:03:43.784 INFO:teuthology.orchestra.run.trial114.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T13:03:43.784 INFO:teuthology.orchestra.run.trial114.stdout:monmaptool: generated fsid f76fe516-b7c8-4f96-a042-60844867d70e 2026-02-20T13:03:43.784 INFO:teuthology.orchestra.run.trial114.stdout:setting min_mon_release = tentacle 2026-02-20T13:03:43.784 INFO:teuthology.orchestra.run.trial114.stdout:epoch 0 2026-02-20T13:03:43.784 INFO:teuthology.orchestra.run.trial114.stdout:fsid f76fe516-b7c8-4f96-a042-60844867d70e 2026-02-20T13:03:43.784 INFO:teuthology.orchestra.run.trial114.stdout:last_changed 2026-02-20T13:03:43.782039+0000 2026-02-20T13:03:43.785 INFO:teuthology.orchestra.run.trial114.stdout:created 2026-02-20T13:03:43.782039+0000 2026-02-20T13:03:43.785 INFO:teuthology.orchestra.run.trial114.stdout:min_mon_release 20 (tentacle) 2026-02-20T13:03:43.785 INFO:teuthology.orchestra.run.trial114.stdout:election_strategy: 1 2026-02-20T13:03:43.785 INFO:teuthology.orchestra.run.trial114.stdout:0: [v2:10.20.193.114:3300/0,v1:10.20.193.114:6789/0] mon.a 2026-02-20T13:03:43.785 INFO:teuthology.orchestra.run.trial114.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T13:03:43.785 DEBUG:teuthology.orchestra.run.trial114:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T13:03:43.843 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f76fe516-b7c8-4f96-a042-60844867d70e... 2026-02-20T13:03:43.844 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T13:03:43.885 DEBUG:teuthology.orchestra.run.trial185:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T13:03:43.924 INFO:teuthology.orchestra.run.trial114.stdout:[global] 2026-02-20T13:03:43.924 INFO:teuthology.orchestra.run.trial114.stdout: chdir = "" 2026-02-20T13:03:43.924 INFO:teuthology.orchestra.run.trial114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T13:03:43.924 INFO:teuthology.orchestra.run.trial114.stdout: auth supported = cephx 2026-02-20T13:03:43.924 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.924 INFO:teuthology.orchestra.run.trial114.stdout: filestore xattr use omap = true 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: mon clock drift allowed = 1.000 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: osd crush chooseleaf type = 0 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: auth debug = true 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: ms die on old message = true 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: ms die on bug = true 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: mon pg warn max object skew = 0 2026-02-20T13:03:43.925 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.926 INFO:teuthology.orchestra.run.trial114.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T13:03:43.926 INFO:teuthology.orchestra.run.trial114.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T13:03:43.926 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.926 INFO:teuthology.orchestra.run.trial114.stdout: osd pool default size = 2 2026-02-20T13:03:43.926 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.926 INFO:teuthology.orchestra.run.trial114.stdout: mon osd allow primary affinity = true 2026-02-20T13:03:43.926 INFO:teuthology.orchestra.run.trial114.stdout: mon osd allow pg remap = true 2026-02-20T13:03:43.926 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on legacy crush tunables = false 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on crush straw calc version zero = false 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on no sortbitwise = false 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on osd down out interval zero = false 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: mon warn on too few osds = false 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: mon_allow_pool_size_one = true 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: osd default data pool replay window = 5 2026-02-20T13:03:43.927 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: mon allow pool delete = true 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: mon cluster log file level = debug 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: debug asserts on shutdown = true 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: mon health detail to clog = false 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: mon host = 10.20.193.114 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: ms client mode = crc 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: ms cluster mode = crc 2026-02-20T13:03:43.928 INFO:teuthology.orchestra.run.trial114.stdout: ms mon client mode = crc 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: ms mon cluster mode = crc 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: ms mon service mode = crc 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: ms service mode = crc 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: osd_pool_default_min_size = 2 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: osd_pool_default_size = 3 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: fsid = f76fe516-b7c8-4f96-a042-60844867d70e 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout:[osd] 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: osd journal size = 100 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.929 INFO:teuthology.orchestra.run.trial114.stdout: osd scrub load threshold = 5.0 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd scrub max interval = 120 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd mclock profile = high_recovery_ops 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd mclock skip benchmark = true 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd recover clone overlap = true 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd recovery max chunk = 1048576 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd debug shutdown = true 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd debug op order = true 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd debug verify stray on activate = true 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd debug trim objects = true 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.930 INFO:teuthology.orchestra.run.trial114.stdout: osd open classes on start = true 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: osd debug pg log writeout = true 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: osd deep scrub update digest min age = 30 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: osd map max advance = 10 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: journal zero on create = true 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: filestore ondisk finisher threads = 3 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: filestore apply finisher threads = 3 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.931 INFO:teuthology.orchestra.run.trial114.stdout: bdev debug aio = true 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: osd debug misdirected ops = true 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug monc = 20 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: crimson cpu num = 4 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: crimson osd obc lru size = 10 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug ms = 20 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug osd = 20 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore = 20 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore backref = 20 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore cache = 20 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore cleaner = 20 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore device = 20 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore epm = 20 2026-02-20T13:03:43.932 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore fixedkv tree = 20 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore journal = 20 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore lba = 20 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore odata = 20 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore omap = 20 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore onode = 20 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore t = 20 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: debug seastore tm = 20 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: osd blocked scrub grace period = 3600 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: osd debug reject backfill probability = 0.3 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: osd delete sleep = 1 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: osd max backfills = 3 2026-02-20T13:03:43.933 INFO:teuthology.orchestra.run.trial114.stdout: osd max markdown count = 1000 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: osd objectstore = seastore 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: osd scrub min interval = 60 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: osd shutdown pgref assert = True 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: osd snap trim sleep = 2 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: osd target transaction size = 5 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: seastore cachepin size pershard = 64M 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: seastore cachepin type = 2Q 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: seastore max concurrent transactions = 8 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout:[mgr] 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: debug ms = 1 2026-02-20T13:03:43.934 INFO:teuthology.orchestra.run.trial114.stdout: debug mgr = 20 2026-02-20T13:03:43.935 INFO:teuthology.orchestra.run.trial114.stdout: debug mon = 20 2026-02-20T13:03:43.935 INFO:teuthology.orchestra.run.trial114.stdout: debug auth = 20 2026-02-20T13:03:43.935 INFO:teuthology.orchestra.run.trial114.stdout: mon reweight min pgs per osd = 4 2026-02-20T13:03:43.935 INFO:teuthology.orchestra.run.trial114.stdout: mon reweight min bytes per osd = 10 2026-02-20T13:03:43.935 INFO:teuthology.orchestra.run.trial114.stdout: mgr/telemetry/nag = false 2026-02-20T13:03:43.935 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.935 INFO:teuthology.orchestra.run.trial114.stdout:[mon] 2026-02-20T13:03:43.935 INFO:teuthology.orchestra.run.trial114.stdout: debug ms = 1 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: debug mon = 20 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: debug paxos = 20 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: debug auth = 20 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: mon data avail warn = 5 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: mon mgr mkfs grace = 240 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: mon reweight min pgs per osd = 4 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: mon osd reporter subtree level = osd 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: mon osd prime pg temp = true 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: mon reweight min bytes per osd = 10 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T13:03:43.936 INFO:teuthology.orchestra.run.trial114.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T13:03:43.937 INFO:teuthology.orchestra.run.trial114.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T13:03:43.937 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.937 INFO:teuthology.orchestra.run.trial114.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T13:03:43.937 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T13:03:43.937 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T13:03:43.937 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.937 INFO:teuthology.orchestra.run.trial114.stdout: # 1m isn't quite enough 2026-02-20T13:03:43.937 INFO:teuthology.orchestra.run.trial114.stdout: mon_down_mkfs_grace = 2m 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: mon_warn_on_filestore_osds = false 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: mon min osdmap epochs = 50 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: mon osdmap full prune interval = 2 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: mon osdmap full prune min = 15 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: mon osdmap full prune txsize = 2 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: osd pool default crimson = True 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: paxos service trim min = 10 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout:[client] 2026-02-20T13:03:43.938 INFO:teuthology.orchestra.run.trial114.stdout: rgw cache enabled = true 2026-02-20T13:03:43.939 INFO:teuthology.orchestra.run.trial114.stdout: rgw enable ops log = true 2026-02-20T13:03:43.939 INFO:teuthology.orchestra.run.trial114.stdout: rgw enable usage log = true 2026-02-20T13:03:43.939 INFO:teuthology.orchestra.run.trial114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T13:03:43.939 INFO:teuthology.orchestra.run.trial114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T13:03:43.939 INFO:teuthology.orchestra.run.trial114.stdout:[mon.a] 2026-02-20T13:03:43.941 INFO:teuthology.orchestra.run.trial185.stdout:[global] 2026-02-20T13:03:43.941 INFO:teuthology.orchestra.run.trial185.stdout: chdir = "" 2026-02-20T13:03:43.941 INFO:teuthology.orchestra.run.trial185.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T13:03:43.941 INFO:teuthology.orchestra.run.trial185.stdout: auth supported = cephx 2026-02-20T13:03:43.941 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.941 INFO:teuthology.orchestra.run.trial185.stdout: filestore xattr use omap = true 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: mon clock drift allowed = 1.000 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: osd crush chooseleaf type = 0 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: auth debug = true 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: ms die on old message = true 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: ms die on bug = true 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: mon pg warn max object skew = 0 2026-02-20T13:03:43.942 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: osd pool default size = 2 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: mon osd allow primary affinity = true 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: mon osd allow pg remap = true 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: mon warn on legacy crush tunables = false 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: mon warn on crush straw calc version zero = false 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: mon warn on no sortbitwise = false 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: mon warn on osd down out interval zero = false 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: mon warn on too few osds = false 2026-02-20T13:03:43.943 INFO:teuthology.orchestra.run.trial185.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: mon_allow_pool_size_one = true 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: osd default data pool replay window = 5 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: mon allow pool delete = true 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: mon cluster log file level = debug 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: debug asserts on shutdown = true 2026-02-20T13:03:43.944 INFO:teuthology.orchestra.run.trial185.stdout: mon health detail to clog = false 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: mon host = 10.20.193.114 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: ms client mode = crc 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: ms cluster mode = crc 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: ms mon client mode = crc 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: ms mon cluster mode = crc 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: ms mon service mode = crc 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: ms service mode = crc 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: osd_pool_default_min_size = 2 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: osd_pool_default_size = 3 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: fsid = f76fe516-b7c8-4f96-a042-60844867d70e 2026-02-20T13:03:43.945 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout:[osd] 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout: osd journal size = 100 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout: osd scrub load threshold = 5.0 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout: osd scrub max interval = 120 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout: osd mclock profile = high_recovery_ops 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout: osd mclock skip benchmark = true 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout: osd recover clone overlap = true 2026-02-20T13:03:43.946 INFO:teuthology.orchestra.run.trial185.stdout: osd recovery max chunk = 1048576 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: osd debug shutdown = true 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: osd debug op order = true 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: osd debug verify stray on activate = true 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: osd debug trim objects = true 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: osd open classes on start = true 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: osd debug pg log writeout = true 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: osd deep scrub update digest min age = 30 2026-02-20T13:03:43.947 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: osd map max advance = 10 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: journal zero on create = true 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: filestore ondisk finisher threads = 3 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: filestore apply finisher threads = 3 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: bdev debug aio = true 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: osd debug misdirected ops = true 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: debug monc = 20 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: crimson cpu num = 4 2026-02-20T13:03:43.948 INFO:teuthology.orchestra.run.trial185.stdout: crimson osd obc lru size = 10 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug ms = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug osd = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore backref = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore cache = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore cleaner = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore device = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore epm = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore fixedkv tree = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore journal = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore lba = 20 2026-02-20T13:03:43.949 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore odata = 20 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore omap = 20 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore onode = 20 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore t = 20 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: debug seastore tm = 20 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: osd blocked scrub grace period = 3600 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: osd debug reject backfill probability = 0.3 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: osd delete sleep = 1 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: osd max backfills = 3 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: osd max markdown count = 1000 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: osd objectstore = seastore 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: osd scrub min interval = 60 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: osd shutdown pgref assert = True 2026-02-20T13:03:43.950 INFO:teuthology.orchestra.run.trial185.stdout: osd snap trim sleep = 2 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: osd target transaction size = 5 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: seastore cachepin size pershard = 64M 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: seastore cachepin type = 2Q 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: seastore max concurrent transactions = 8 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout:[mgr] 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: debug ms = 1 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: debug mgr = 20 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: debug mon = 20 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: debug auth = 20 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: mon reweight min pgs per osd = 4 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: mon reweight min bytes per osd = 10 2026-02-20T13:03:43.951 INFO:teuthology.orchestra.run.trial185.stdout: mgr/telemetry/nag = false 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout:[mon] 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: debug ms = 1 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: debug mon = 20 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: debug paxos = 20 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: debug auth = 20 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: mon data avail warn = 5 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: mon mgr mkfs grace = 240 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: mon reweight min pgs per osd = 4 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: mon osd reporter subtree level = osd 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: mon osd prime pg temp = true 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: mon reweight min bytes per osd = 10 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.952 INFO:teuthology.orchestra.run.trial185.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: # 1m isn't quite enough 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: mon_down_mkfs_grace = 2m 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: mon_warn_on_filestore_osds = false 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: mon min osdmap epochs = 50 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: mon osdmap full prune interval = 2 2026-02-20T13:03:43.953 INFO:teuthology.orchestra.run.trial185.stdout: mon osdmap full prune min = 15 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout: mon osdmap full prune txsize = 2 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout: osd pool default crimson = True 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout: paxos service trim min = 10 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout: 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout:[client] 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout: rgw cache enabled = true 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout: rgw enable ops log = true 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout: rgw enable usage log = true 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T13:03:43.954 INFO:teuthology.orchestra.run.trial185.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T13:03:43.955 INFO:teuthology.orchestra.run.trial185.stdout:[mon.a] 2026-02-20T13:03:43.955 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T13:03:43.955 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T13:03:44.032 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T13:03:44.032 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:03:44.032 DEBUG:teuthology.orchestra.run.trial114:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T13:03:44.050 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:03:44.050 DEBUG:teuthology.orchestra.run.trial114:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T13:03:44.106 INFO:tasks.ceph:Sending monmap to node ubuntu@trial114.front.sepia.ceph.com 2026-02-20T13:03:44.107 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:03:44.107 DEBUG:teuthology.orchestra.run.trial114:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T13:03:44.107 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T13:03:44.180 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:03:44.180 DEBUG:teuthology.orchestra.run.trial114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T13:03:44.236 INFO:tasks.ceph:Sending monmap to node ubuntu@trial185.front.sepia.ceph.com 2026-02-20T13:03:44.237 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:03:44.237 DEBUG:teuthology.orchestra.run.trial185:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T13:03:44.237 DEBUG:teuthology.orchestra.run.trial185:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T13:03:44.271 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:03:44.271 DEBUG:teuthology.orchestra.run.trial185:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T13:03:44.328 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T13:03:44.328 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T13:03:44.328 DEBUG:teuthology.orchestra.run.trial185:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T13:03:44.419 INFO:teuthology.orchestra.run.trial185.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T13:03:44.422 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T13:03:44.422 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T13:03:44.422 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T13:03:44.465 INFO:teuthology.orchestra.run.trial114.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T13:03:44.477 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-20T13:03:44.519 INFO:teuthology.orchestra.run.trial185.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-20T13:03:44.531 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T13:03:44.532 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial185.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T13:03:44.532 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T13:03:44.559 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T13:03:44.559 INFO:tasks.ceph:role: osd.0 2026-02-20T13:03:44.559 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial114.front.sepia.ceph.com 2026-02-20T13:03:44.559 DEBUG:teuthology.orchestra.run.trial114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T13:03:44.626 INFO:teuthology.orchestra.run.trial114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T13:03:44.626 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T13:03:44.626 INFO:teuthology.orchestra.run.trial114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T13:03:44.626 INFO:teuthology.orchestra.run.trial114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T13:03:44.626 INFO:teuthology.orchestra.run.trial114.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T13:03:44.626 INFO:teuthology.orchestra.run.trial114.stdout: = sunit=0 swidth=0 blks 2026-02-20T13:03:44.627 INFO:teuthology.orchestra.run.trial114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T13:03:44.627 INFO:teuthology.orchestra.run.trial114.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T13:03:44.627 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T13:03:44.627 INFO:teuthology.orchestra.run.trial114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T13:03:45.197 INFO:teuthology.orchestra.run.trial114.stdout:Discarding blocks...Done. 2026-02-20T13:03:45.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial114.front.sepia.ceph.com -o noatime 2026-02-20T13:03:45.200 DEBUG:teuthology.orchestra.run.trial114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T13:03:45.273 DEBUG:teuthology.orchestra.run.trial114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T13:03:45.342 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T13:03:45.407 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T13:03:45.407 INFO:tasks.ceph:role: osd.1 2026-02-20T13:03:45.407 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial114.front.sepia.ceph.com 2026-02-20T13:03:45.407 DEBUG:teuthology.orchestra.run.trial114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T13:03:45.472 INFO:teuthology.orchestra.run.trial114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T13:03:45.472 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T13:03:45.472 INFO:teuthology.orchestra.run.trial114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T13:03:45.472 INFO:teuthology.orchestra.run.trial114.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T13:03:45.472 INFO:teuthology.orchestra.run.trial114.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T13:03:45.472 INFO:teuthology.orchestra.run.trial114.stdout: = sunit=0 swidth=0 blks 2026-02-20T13:03:45.472 INFO:teuthology.orchestra.run.trial114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T13:03:45.472 INFO:teuthology.orchestra.run.trial114.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T13:03:45.472 INFO:teuthology.orchestra.run.trial114.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T13:03:45.473 INFO:teuthology.orchestra.run.trial114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T13:03:46.033 INFO:teuthology.orchestra.run.trial114.stdout:Discarding blocks...Done. 2026-02-20T13:03:46.035 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial114.front.sepia.ceph.com -o noatime 2026-02-20T13:03:46.035 DEBUG:teuthology.orchestra.run.trial114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T13:03:46.103 DEBUG:teuthology.orchestra.run.trial114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T13:03:46.170 DEBUG:teuthology.orchestra.run.trial114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T13:03:46.320 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T13:03:46.374 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:46,371 seastar - Reactor backend: linux-aio 2026-02-20T13:03:46.390 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:46,388 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:46.391 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:46,388 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:46.393 INFO:teuthology.orchestra.run.trial114.stderr:==39170==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T13:03:46.449 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:46,446 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T13:03:46.449 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:46,446 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T13:03:46.450 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:46,446 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T13:03:46.450 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:46,446 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T13:03:46.450 INFO:teuthology.orchestra.run.trial114.stderr:DEBUG 2026-02-20 13:03:46,447 [shard 0:main] seastar - reactor::drain 2026-02-20T13:03:48.490 INFO:teuthology.orchestra.run.trial114.stderr:----------------------------------------------------- 2026-02-20T13:03:48.490 INFO:teuthology.orchestra.run.trial114.stderr:Suppressions used: 2026-02-20T13:03:48.490 INFO:teuthology.orchestra.run.trial114.stderr: count bytes template 2026-02-20T13:03:48.490 INFO:teuthology.orchestra.run.trial114.stderr: 1 8 MallocExtension::Register 2026-02-20T13:03:48.490 INFO:teuthology.orchestra.run.trial114.stderr:----------------------------------------------------- 2026-02-20T13:03:48.490 INFO:teuthology.orchestra.run.trial114.stderr: 2026-02-20T13:03:48.509 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T13:03:48.509 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T13:03:48.553 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T13:03:48.554 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T13:03:48.560 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:48,558 seastar - Reactor backend: linux-aio 2026-02-20T13:03:48.569 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:48,567 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:48.570 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:48,567 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:48.574 INFO:teuthology.orchestra.run.trial114.stderr:==39168==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T13:03:48.574 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:48,571 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T13:03:48.632 INFO:teuthology.orchestra.run.trial114.stderr:DEBUG 2026-02-20 13:03:48,629 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T13:03:48.711 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6583 /lib64/libasan.so.8+0x15197 0x3132661 0x993a6f5 0x993aa6a 0x993b519 0x993ba17 0x993c047 0x993c1b1 0x9a49461 0x9a5c268 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:48.712 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x101c2a /lib64/libasan.so.8+0xed720 0xc80a85 0x786f34d 0x7b60233 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:48.712 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x191cbf /lib64/libasan.so.8+0xb9ea /lib64/libasan.so.8+0xbf98 /lib64/libasan.so.8+0xc08c /lib64/libasan.so.8+0xc360 /lib64/libasan.so.8+0xc553 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9a3e7ca 0x9a3e896 0x9a58b45 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:48.712 INFO:teuthology.orchestra.run.trial114.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9a9f911e 0xffffffff9a9f9774 0xffffffff9a9fb709 0xffffffff9a9fcc31 0xffffffff9aa24893 0xffffffff9aa24a55 0xffffffff9a9cb80e 0xffffffff9a9d3aeb 0xffffffff9a9d3f4b 0xffffffff9a6910d2 0xffffffff9b34d451 0xffffffff9b400ba2 2026-02-20T13:03:48.744 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x157c2 0x1022b6b 0x10dd80a 0x993a077 0x993a541 0x993a7b4 0x993aa6a 0x993b02c 0x9940151 0x9940831 0x9a59644 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b64dd4 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6fe0e 0x7510654 0x75107a8 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:03:48.811 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x29f2c8e 0x7d16bd8 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:03:48.815 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x299d631 0x29f3c36 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:48.846 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151e3 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:48.846 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x12978a /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:48.968 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ec6 /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x99c2297 0x9a5fc2e 0x786f2eb 0x7b60838 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:48.968 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb04ff /lib64/libasan.so.8+0xb1437 0xb3a067 0x1022af4 0x10dd80a 0x993d61a 0x993df59 0x9a5552d 0x9a5fc13 0x786f2eb 0x7b60233 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:48.968 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x993c3b6 0x9a4d09e 0x9a4ea44 0x9a4f09e 0x9a4f5e4 0x9a59876 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:49.050 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x29f3ab5 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:03:49.063 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6583 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:49.063 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x299d65a 0x29f3c36 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:49.064 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129747 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:51.202 INFO:teuthology.orchestra.run.trial114.stderr:----------------------------------------------------- 2026-02-20T13:03:51.202 INFO:teuthology.orchestra.run.trial114.stderr:Suppressions used: 2026-02-20T13:03:51.202 INFO:teuthology.orchestra.run.trial114.stderr: count bytes template 2026-02-20T13:03:51.202 INFO:teuthology.orchestra.run.trial114.stderr: 1 8 MallocExtension::Register 2026-02-20T13:03:51.202 INFO:teuthology.orchestra.run.trial114.stderr:----------------------------------------------------- 2026-02-20T13:03:51.203 INFO:teuthology.orchestra.run.trial114.stderr: 2026-02-20T13:03:51.238 DEBUG:teuthology.orchestra.run.trial114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T13:03:51.263 DEBUG:teuthology.orchestra.run.trial114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T13:03:51.413 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T13:03:51.473 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:51,471 seastar - Reactor backend: linux-aio 2026-02-20T13:03:51.482 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:51,480 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:51.482 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:51,480 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:51.485 INFO:teuthology.orchestra.run.trial114.stderr:==39233==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T13:03:51.542 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:51,539 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T13:03:51.542 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:51,539 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T13:03:51.542 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:51,539 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T13:03:51.542 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:51,539 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T13:03:51.542 INFO:teuthology.orchestra.run.trial114.stderr:DEBUG 2026-02-20 13:03:51,539 [shard 0:main] seastar - reactor::drain 2026-02-20T13:03:53.580 INFO:teuthology.orchestra.run.trial114.stderr:----------------------------------------------------- 2026-02-20T13:03:53.580 INFO:teuthology.orchestra.run.trial114.stderr:Suppressions used: 2026-02-20T13:03:53.580 INFO:teuthology.orchestra.run.trial114.stderr: count bytes template 2026-02-20T13:03:53.580 INFO:teuthology.orchestra.run.trial114.stderr: 1 8 MallocExtension::Register 2026-02-20T13:03:53.580 INFO:teuthology.orchestra.run.trial114.stderr:----------------------------------------------------- 2026-02-20T13:03:53.580 INFO:teuthology.orchestra.run.trial114.stderr: 2026-02-20T13:03:53.600 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T13:03:53.600 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T13:03:53.643 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T13:03:53.643 INFO:teuthology.orchestra.run.trial114.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T13:03:53.649 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:53,647 seastar - Reactor backend: linux-aio 2026-02-20T13:03:53.659 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:53,656 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:53.659 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:53,656 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:53.662 INFO:teuthology.orchestra.run.trial114.stderr:==39231==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T13:03:53.663 INFO:teuthology.orchestra.run.trial114.stderr:INFO 2026-02-20 13:03:53,660 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T13:03:53.722 INFO:teuthology.orchestra.run.trial114.stderr:DEBUG 2026-02-20 13:03:53,720 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T13:03:53.802 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0xc80bf9 0x10dd6de 0x10dd7ff 0x993a244 0x993a541 0x993a7b4 0x993c4db 0x9a485e6 0x9a48d5f 0x9a4924a 0x9a495dd 0x9a5c268 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:53.803 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ed3 /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x157c7 0x35b6949 0x35b6ac9 0x35d2e60 0x9947b1f 0x9947c4c 0x9a409e5 0x9a40b7a 0x9a40f0c 0x9a41117 0x9a41453 0x9a41874 0x9a59007 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:53.803 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9808b5b 0x9a3729a 0x9a373c8 0x9a54fa3 0x9a55746 0x9a5fc13 0x786f2eb 0x7b60233 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:53.803 INFO:teuthology.orchestra.run.trial114.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9a9f9123 0xffffffff9a9f9774 0xffffffff9a9fb709 0xffffffff9a9fcc31 0xffffffff9aa24893 0xffffffff9aa24a55 0xffffffff9a9c97c8 0xffffffff9a9d3aeb 0xffffffff9a9d3f4b 0xffffffff9a6910d2 0xffffffff9b34d451 0xffffffff9b400ba2 2026-02-20T13:03:53.899 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x29f3a8b 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:03:53.938 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x7d16bc3 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:53.938 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x29f3548 0x7d16bfa 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:53.939 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfcaef /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:54.061 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x3131307 0x993a522 0x993a7b4 0x993c4db 0x993ca28 0x993cc27 0x9a4ee89 0x9a4f5e4 0x9a59876 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:54.062 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x10dd764 0x10dd7ff 0x993a077 0x993a541 0x993a7b4 0x993c4db 0x993ca28 0x993cc27 0x9a4ee89 0x9a4f5e4 0x9a59876 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:54.062 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0xc88428 0x10dd6fb 0x10dd7ff 0x9a4a069 0x9a4a3ae 0x9a4a731 0x9a5a88c 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:54.144 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x299d65a 0x29f3c36 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:03:54.157 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129787 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:54.158 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x29f2f8d 0x7d16bed 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:54.158 INFO:teuthology.orchestra.run.trial114.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x341f /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:03:56.301 INFO:teuthology.orchestra.run.trial114.stderr:----------------------------------------------------- 2026-02-20T13:03:56.301 INFO:teuthology.orchestra.run.trial114.stderr:Suppressions used: 2026-02-20T13:03:56.301 INFO:teuthology.orchestra.run.trial114.stderr: count bytes template 2026-02-20T13:03:56.301 INFO:teuthology.orchestra.run.trial114.stderr: 1 8 MallocExtension::Register 2026-02-20T13:03:56.301 INFO:teuthology.orchestra.run.trial114.stderr:----------------------------------------------------- 2026-02-20T13:03:56.301 INFO:teuthology.orchestra.run.trial114.stderr: 2026-02-20T13:03:56.338 DEBUG:teuthology.orchestra.run.trial114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T13:03:56.363 DEBUG:teuthology.orchestra.run.trial185:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T13:03:56.389 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T13:03:56.389 INFO:tasks.ceph:role: osd.2 2026-02-20T13:03:56.389 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial185.front.sepia.ceph.com 2026-02-20T13:03:56.389 DEBUG:teuthology.orchestra.run.trial185:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T13:03:56.454 INFO:teuthology.orchestra.run.trial185.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T13:03:56.454 INFO:teuthology.orchestra.run.trial185.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T13:03:56.454 INFO:teuthology.orchestra.run.trial185.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T13:03:56.455 INFO:teuthology.orchestra.run.trial185.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T13:03:56.455 INFO:teuthology.orchestra.run.trial185.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T13:03:56.455 INFO:teuthology.orchestra.run.trial185.stdout: = sunit=0 swidth=0 blks 2026-02-20T13:03:56.455 INFO:teuthology.orchestra.run.trial185.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T13:03:56.455 INFO:teuthology.orchestra.run.trial185.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T13:03:56.455 INFO:teuthology.orchestra.run.trial185.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T13:03:56.455 INFO:teuthology.orchestra.run.trial185.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T13:03:57.036 INFO:teuthology.orchestra.run.trial185.stdout:Discarding blocks...Done. 2026-02-20T13:03:57.037 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial185.front.sepia.ceph.com -o noatime 2026-02-20T13:03:57.037 DEBUG:teuthology.orchestra.run.trial185:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-20T13:03:57.106 DEBUG:teuthology.orchestra.run.trial185:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T13:03:57.173 DEBUG:teuthology.orchestra.run.trial185:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-20T13:03:57.238 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T13:03:57.238 INFO:tasks.ceph:role: osd.3 2026-02-20T13:03:57.238 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial185.front.sepia.ceph.com 2026-02-20T13:03:57.238 DEBUG:teuthology.orchestra.run.trial185:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout: = sunit=0 swidth=0 blks 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T13:03:57.305 INFO:teuthology.orchestra.run.trial185.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T13:03:57.865 INFO:teuthology.orchestra.run.trial185.stdout:Discarding blocks...Done. 2026-02-20T13:03:57.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial185.front.sepia.ceph.com -o noatime 2026-02-20T13:03:57.867 DEBUG:teuthology.orchestra.run.trial185:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-20T13:03:57.935 DEBUG:teuthology.orchestra.run.trial185:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-20T13:03:58.002 DEBUG:teuthology.orchestra.run.trial185:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T13:03:58.154 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T13:03:58.207 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:03:58,206 seastar - Reactor backend: linux-aio 2026-02-20T13:03:58.221 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:03:58,219 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:58.221 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:03:58,219 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:03:58.223 INFO:teuthology.orchestra.run.trial185.stderr:==38686==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T13:03:58.279 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:03:58,278 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T13:03:58.279 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:03:58,278 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T13:03:58.280 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:03:58,278 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T13:03:58.280 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:03:58,278 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T13:03:58.280 INFO:teuthology.orchestra.run.trial185.stderr:DEBUG 2026-02-20 13:03:58,278 [shard 0:main] seastar - reactor::drain 2026-02-20T13:04:00.359 INFO:teuthology.orchestra.run.trial185.stderr:----------------------------------------------------- 2026-02-20T13:04:00.359 INFO:teuthology.orchestra.run.trial185.stderr:Suppressions used: 2026-02-20T13:04:00.360 INFO:teuthology.orchestra.run.trial185.stderr: count bytes template 2026-02-20T13:04:00.360 INFO:teuthology.orchestra.run.trial185.stderr: 1 8 MallocExtension::Register 2026-02-20T13:04:00.360 INFO:teuthology.orchestra.run.trial185.stderr:----------------------------------------------------- 2026-02-20T13:04:00.360 INFO:teuthology.orchestra.run.trial185.stderr: 2026-02-20T13:04:00.379 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T13:04:00.379 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T13:04:00.422 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T13:04:00.423 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T13:04:00.429 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:00,428 seastar - Reactor backend: linux-aio 2026-02-20T13:04:00.441 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:00,440 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:04:00.441 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:00,440 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:04:00.446 INFO:teuthology.orchestra.run.trial185.stderr:==38684==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T13:04:00.446 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:00,445 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T13:04:00.506 INFO:teuthology.orchestra.run.trial185.stderr:DEBUG 2026-02-20 13:04:00,504 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T13:04:00.585 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x6f3ed4f 0x9a4341a 0x9a43632 0x9a43904 0x7b6093f 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.585 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x98f4d21 0x9a4956c 0x9a5c268 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.585 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b364 /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xb3a067 0x1022af4 0x10dd80a 0x993e356 0x993ec95 0x9a582f1 0x9a59211 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.617 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15876 0x993d37e 0x993df59 0x9a5552d 0x9a5fc13 0x786f2eb 0x7b65471 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6fe0e 0x7510654 0x75107a8 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:04:00.685 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x29f3665 0x7d16bfa 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:04:00.721 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x29f2a81 0x7d16bd8 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.722 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x7d16baa 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.722 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ebc /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.843 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x9947725 0x9a4fd0c 0x9a55108 0x9a55746 0x9a5fc13 0x786f2eb 0x7b60233 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.843 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x104e4a /lib64/libasan.so.8+0xea9a /lib64/libasan.so.8+0xec776 0xc80a85 0x3135771 0x3135ad7 0x3135bcc 0x6f3edc2 0x7b6097e 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.843 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x12976b /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x3132661 0x993a6f5 0x993c4db 0x993ca28 0x993cc27 0x9a4ee89 0x9a4f5e4 0x9a59876 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.925 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c6 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:04:00.939 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x7d16bd0 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.939 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:00.940 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x29f2c88 0x7d16bd8 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:03.089 INFO:teuthology.orchestra.run.trial185.stderr:----------------------------------------------------- 2026-02-20T13:04:03.089 INFO:teuthology.orchestra.run.trial185.stderr:Suppressions used: 2026-02-20T13:04:03.089 INFO:teuthology.orchestra.run.trial185.stderr: count bytes template 2026-02-20T13:04:03.089 INFO:teuthology.orchestra.run.trial185.stderr: 1 8 MallocExtension::Register 2026-02-20T13:04:03.089 INFO:teuthology.orchestra.run.trial185.stderr:----------------------------------------------------- 2026-02-20T13:04:03.089 INFO:teuthology.orchestra.run.trial185.stderr: 2026-02-20T13:04:03.123 DEBUG:teuthology.orchestra.run.trial185:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T13:04:03.148 DEBUG:teuthology.orchestra.run.trial185:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T13:04:03.298 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T13:04:03.351 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:03,350 seastar - Reactor backend: linux-aio 2026-02-20T13:04:03.361 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:03,359 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:04:03.361 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:03,359 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:04:03.363 INFO:teuthology.orchestra.run.trial185.stderr:==38749==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T13:04:03.422 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:03,420 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T13:04:03.422 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:03,420 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T13:04:03.423 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:03,420 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T13:04:03.423 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:03,420 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T13:04:03.423 INFO:teuthology.orchestra.run.trial185.stderr:DEBUG 2026-02-20 13:04:03,420 [shard 0:main] seastar - reactor::drain 2026-02-20T13:04:05.485 INFO:teuthology.orchestra.run.trial185.stderr:----------------------------------------------------- 2026-02-20T13:04:05.485 INFO:teuthology.orchestra.run.trial185.stderr:Suppressions used: 2026-02-20T13:04:05.485 INFO:teuthology.orchestra.run.trial185.stderr: count bytes template 2026-02-20T13:04:05.485 INFO:teuthology.orchestra.run.trial185.stderr: 1 8 MallocExtension::Register 2026-02-20T13:04:05.485 INFO:teuthology.orchestra.run.trial185.stderr:----------------------------------------------------- 2026-02-20T13:04:05.485 INFO:teuthology.orchestra.run.trial185.stderr: 2026-02-20T13:04:05.505 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T13:04:05.505 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T13:04:05.550 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T13:04:05.551 INFO:teuthology.orchestra.run.trial185.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T13:04:05.557 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:05,556 seastar - Reactor backend: linux-aio 2026-02-20T13:04:05.569 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:05,567 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:04:05.569 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:05,567 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T13:04:05.574 INFO:teuthology.orchestra.run.trial185.stderr:==38747==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T13:04:05.574 INFO:teuthology.orchestra.run.trial185.stderr:INFO 2026-02-20 13:04:05,572 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T13:04:05.634 INFO:teuthology.orchestra.run.trial185.stderr:DEBUG 2026-02-20 13:04:05,632 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T13:04:05.714 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1583b 0x1022b6b 0x10dd80a 0x993a244 0x993a541 0x993a7b4 0x993c4db 0x9a4d09e 0x9a4ea44 0x9a4f09e 0x9a4f5e4 0x9a59876 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:05.714 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ed3 /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x993a0e0 0x993a541 0x993a7b4 0x993aa6a 0x993b02c 0x9940151 0x9940831 0x9a59644 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:05.714 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0xc88483 0x10dd6fb 0x10dd7ff 0x993e356 0x993e603 0x9a59181 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f6f022 0x6f72e23 0x6f789cd 0x73e30d9 0x7412614 0x7256527 0x725661f 0x732cdbe 0x732ce77 0x732d02e 0x7412695 0x725669c 0x7256721 0x728124b 0x73ebced 0x73ebd72 0x73ebe50 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:05.746 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x191ccd /lib64/libasan.so.8+0xc748 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x1305e7e 0x29f928a 0x7f092ca 0x7f09880 0x7f099ac 0x7f0be3b 0x7e1dab7 0x7e1dd74 0x7e1e98b 0x7e1f8f4 0x8cc05d5 0x8cc2f43 0x78269a7 0x783a722 0x6f701ed 0x7510654 0x75107a8 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:04:05.747 INFO:teuthology.orchestra.run.trial185.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffbb1cb8be 0xffffffffbb1d3aeb 0xffffffffbb1d3f4b 0xffffffffbae910d2 0xffffffffbbb4d451 0xffffffffbbc00ba2 2026-02-20T13:04:05.787 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x91b11ac 0x7a2b38c 0x70e904b 0x6f6fe0e 0x7510654 0x75107a8 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:05.813 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x299d65a 0x29f3c36 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:04:05.851 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x29f2f85 0x7d16bed 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:05.851 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:05.855 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:05.978 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xd91811 0x9a5f275 0x786f2eb 0x7b60838 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:05.978 INFO:teuthology.orchestra.run.trial185.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffbb4b46d0 0xffffffffbb01f791 0xffffffffbb01fb20 0xffffffffbae9525e 0xffffffffbb1e61a9 0xffffffffbb1c9715 0xffffffffbb1d3aeb 0xffffffffbb1d3f4b 0xffffffffbae910d2 0xffffffffbbb4d451 0xffffffffbbc00ba2 2026-02-20T13:04:05.978 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x191c62 /lib64/libasan.so.8+0xc748 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xd80173 0xd80b06 0x9a4188c 0x9a59007 0x9a5dcef 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:05.978 INFO:teuthology.orchestra.run.trial185.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffbbb605f6 0xffffffffbbb603b5 0xffffffffbb1e68c5 0xffffffffbb1cb8ba 0xffffffffbb1d3aeb 0xffffffffbb1d3f4b 0xffffffffbae910d2 0xffffffffbbb4d451 0xffffffffbbc00ba2 2026-02-20T13:04:05.978 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x10dd764 0x10dd7ff 0x993a077 0x993a541 0x993a7b4 0x993aa6a 0x993b519 0x993ba17 0x993c047 0x993c1b1 0x9a49461 0x9a5c268 0x99c20b5 0x99c10b5 0x7b60901 0x7b6a470 0x7a0ec75 0x7a27c05 0x70e904b 0x6f0b27c 0x6f0d5e4 0x73e2d78 0x740ccd4 0x7254c6e 0x7254d66 0x732c65e 0x732c717 0x732c8ce 0x740cd55 0x7254de3 0x7254e68 0x727c2ab 0x73ea73c 0x73ea7c1 0x73ea89f 0x740ced4 0x7387fb8 0x7552c41 0x73f3ad4 0x73f3b4f 0x74a8152 0x759b55c 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:06.060 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x299d65a 0x29f3c36 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9bd1514 0x9a03f3d 0x9a04778 0xe4eab2 /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb17854 2026-02-20T13:04:06.074 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:06.074 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ed7 /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x29f3c95 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:06.075 INFO:teuthology.orchestra.run.trial185.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x9c8bb26 0x9abe76d 0x9af96d3 0x9afcc8c 0x9afcefa 0x9afd042 0x9afd501 /lib64/libc.so.6+0x3fc2f 0x299d65a 0x29f3c36 0x7d16bbf 0x7dc7a38 0x7dc852f 0x7d5e079 0x7821d85 0x7822a7a 0x796e11e 0x77eae6e 0x7838d3e 0x78b488f 0x78b4b08 0x796000b 0x796016a 0x796e281 0x7816354 0x794cb2e 0x794cbbe 0x794cc62 0x73b03ce 0x73ce72b 0x7458f1d 0x75ac064 0x9bc0b9d 0x9ac6d0c 0x9b7f759 0x9bcfcf7 0x9d147e2 0x9d14e5e 0x265f87f 0xa34f610 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T13:04:08.227 INFO:teuthology.orchestra.run.trial185.stderr:----------------------------------------------------- 2026-02-20T13:04:08.227 INFO:teuthology.orchestra.run.trial185.stderr:Suppressions used: 2026-02-20T13:04:08.228 INFO:teuthology.orchestra.run.trial185.stderr: count bytes template 2026-02-20T13:04:08.228 INFO:teuthology.orchestra.run.trial185.stderr: 1 8 MallocExtension::Register 2026-02-20T13:04:08.228 INFO:teuthology.orchestra.run.trial185.stderr:----------------------------------------------------- 2026-02-20T13:04:08.228 INFO:teuthology.orchestra.run.trial185.stderr: 2026-02-20T13:04:08.261 DEBUG:teuthology.orchestra.run.trial185:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-20T13:04:08.285 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T13:04:08.285 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:04:08.285 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T13:04:08.311 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:04:08.311 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T13:04:08.375 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:04:08.375 DEBUG:teuthology.orchestra.run.trial185:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T13:04:08.401 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:04:08.401 DEBUG:teuthology.orchestra.run.trial185:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T13:04:08.468 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:04:08.468 DEBUG:teuthology.orchestra.run.trial185:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-20T13:04:08.533 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:04:08.533 DEBUG:teuthology.orchestra.run.trial114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T13:04:08.552 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:04:08.552 DEBUG:teuthology.orchestra.run.trial185:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-20T13:04:08.590 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T13:04:08.591 DEBUG:teuthology.orchestra.run.trial114:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T13:04:08.615 INFO:teuthology.orchestra.run.trial114.stdout:[osd.0] 2026-02-20T13:04:08.615 INFO:teuthology.orchestra.run.trial114.stdout: key = AQC0W5hpcf3DJRAADgYjeK7LCF3f8+RUKJmJWg== 2026-02-20T13:04:08.615 INFO:teuthology.orchestra.run.trial114.stdout:[osd.1] 2026-02-20T13:04:08.615 INFO:teuthology.orchestra.run.trial114.stdout: key = AQC5W5hpPyUpKxAA1jj7Ft1R3A1ZLfes81xx9g== 2026-02-20T13:04:08.615 INFO:teuthology.orchestra.run.trial114.stdout:[mgr.x] 2026-02-20T13:04:08.616 INFO:teuthology.orchestra.run.trial114.stdout: key = AQCwW5hpK7zgGBAA3R24P5Hee1gt1AEGerXR3Q== 2026-02-20T13:04:08.616 INFO:teuthology.orchestra.run.trial114.stdout:[osd.2] 2026-02-20T13:04:08.616 INFO:teuthology.orchestra.run.trial114.stdout: key = AQDAW5hpBx9KHhAAl6SwsWl0YiY+FibN38C1vw== 2026-02-20T13:04:08.616 INFO:teuthology.orchestra.run.trial114.stdout:[osd.3] 2026-02-20T13:04:08.616 INFO:teuthology.orchestra.run.trial114.stdout: key = AQDFW5hpwvjpJRAAm73ZgiapsKM7ohLZlaIAdA== 2026-02-20T13:04:08.616 INFO:teuthology.orchestra.run.trial114.stdout:[client.0] 2026-02-20T13:04:08.616 INFO:teuthology.orchestra.run.trial114.stdout: key = AQCwW5hpZViaGxAAJfDXXDnZ9pZWV8rMKjwO5w== 2026-02-20T13:04:08.616 INFO:teuthology.orchestra.run.trial114.stdout:[client.1] 2026-02-20T13:04:08.616 INFO:teuthology.orchestra.run.trial114.stdout: key = AQCwW5hpS+zaHhAAfih1SkPqmVPR4oemkNJxhQ== 2026-02-20T13:04:08.617 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T13:04:08.705 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T13:04:08.754 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T13:04:08.803 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T13:04:08.851 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T13:04:08.900 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T13:04:08.949 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T13:04:08.999 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T13:04:08.999 DEBUG:teuthology.orchestra.run.trial114:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T13:04:09.023 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T13:04:09.108 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:09.106+0000 7f00b524ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.109 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:09.106+0000 7f00b524ac00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.120 DEBUG:teuthology.orchestra.run.trial114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T13:04:09.145 DEBUG:teuthology.orchestra.run.trial114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T13:04:09.200 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T13:04:09.201 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T13:04:09.201 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T13:04:09.243 INFO:tasks.ceph.mon.a:Started 2026-02-20T13:04:09.243 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T13:04:09.243 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T13:04:09.243 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T13:04:09.245 INFO:tasks.ceph.mgr.x:Started 2026-02-20T13:04:09.245 DEBUG:tasks.ceph:set 0 configs 2026-02-20T13:04:09.245 DEBUG:teuthology.orchestra.run.trial114:> sudo ceph --cluster ceph config dump 2026-02-20T13:04:09.304 INFO:tasks.ceph.mon.a.trial114.stderr:2026-02-20T13:04:09.301+0000 7f645ee83c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.304 INFO:tasks.ceph.mon.a.trial114.stderr:2026-02-20T13:04:09.301+0000 7f645ee83c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.304 INFO:tasks.ceph.mon.a.trial114.stderr:2026-02-20T13:04:09.301+0000 7f645ee83c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.305 INFO:tasks.ceph.mgr.x.trial185.stderr:2026-02-20T13:04:09.302+0000 7ff2d042efc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.317 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:09.312+0000 7f54cfb8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.323 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:09.320+0000 7f54cfb8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.356 INFO:teuthology.orchestra.run.trial114.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T13:04:09.363 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T13:04:09.364 DEBUG:teuthology.orchestra.run.trial114:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T13:04:09.371 INFO:tasks.ceph.mgr.x.trial185.stderr:2026-02-20T13:04:09.368+0000 7ff2d042efc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.372 INFO:tasks.ceph.mgr.x.trial185.stderr:2026-02-20T13:04:09.369+0000 7ff2d042efc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.438 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:09.432+0000 7f7639acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.440 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:09.437+0000 7f7639acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.477 INFO:teuthology.orchestra.run.trial114.stderr:adjusted tunables profile to default 2026-02-20T13:04:09.486 INFO:tasks.ceph:check_enable_crimson: True 2026-02-20T13:04:09.486 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-20T13:04:09.486 DEBUG:teuthology.orchestra.run.trial114:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-20T13:04:09.560 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:09.554+0000 7f8e9c0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.562 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:09.560+0000 7f8e9c0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:09.601 INFO:tasks.ceph.mon.a.trial114.stderr:2026-02-20T13:04:09.598+0000 7f64565f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-20T13:04:09.601 INFO:tasks.ceph.mon.a.trial114.stderr:Please be aware that this feature is experimental, untested, 2026-02-20T13:04:09.601 INFO:tasks.ceph.mon.a.trial114.stderr:unsupported, and may result in data corruption, data loss, 2026-02-20T13:04:09.601 INFO:tasks.ceph.mon.a.trial114.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-20T13:04:09.601 INFO:tasks.ceph.mon.a.trial114.stderr:feature with important data. 2026-02-20T13:04:09.601 INFO:tasks.ceph.mon.a.trial114.stderr: 2026-02-20T13:04:10.204 INFO:tasks.ceph.mgr.x.trial185.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T13:04:10.204 INFO:tasks.ceph.mgr.x.trial185.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T13:04:10.204 INFO:tasks.ceph.mgr.x.trial185.stderr: from numpy import show_config as show_numpy_config 2026-02-20T13:04:10.489 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T13:04:10.489 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:04:10.489 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T13:04:10.514 DEBUG:teuthology.orchestra.run.trial114:> set -ex 2026-02-20T13:04:10.515 DEBUG:teuthology.orchestra.run.trial114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T13:04:10.577 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:04:10.577 DEBUG:teuthology.orchestra.run.trial185:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T13:04:10.603 DEBUG:teuthology.orchestra.run.trial185:> set -ex 2026-02-20T13:04:10.603 DEBUG:teuthology.orchestra.run.trial185:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-20T13:04:10.668 DEBUG:teuthology.orchestra.run.trial185:> sudo ceph --cluster ceph osd new 005814e5-2d77-4b80-83a7-ec319b0825d5 0 2026-02-20T13:04:10.780 INFO:teuthology.orchestra.run.trial185.stderr:2026-02-20T13:04:10.774+0000 7ffb327cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:10.783 INFO:teuthology.orchestra.run.trial185.stderr:2026-02-20T13:04:10.780+0000 7ffb327cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:10.821 INFO:teuthology.orchestra.run.trial185.stdout:0 2026-02-20T13:04:10.830 DEBUG:teuthology.orchestra.run.trial185:> sudo ceph --cluster ceph osd new c9655ff9-1fda-4405-a69a-c1096d0cbf93 1 2026-02-20T13:04:10.905 INFO:teuthology.orchestra.run.trial185.stderr:2026-02-20T13:04:10.899+0000 7f10ba50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:10.907 INFO:teuthology.orchestra.run.trial185.stderr:2026-02-20T13:04:10.904+0000 7f10b9282640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:10.945 INFO:teuthology.orchestra.run.trial185.stdout:1 2026-02-20T13:04:10.953 DEBUG:teuthology.orchestra.run.trial185:> sudo ceph --cluster ceph osd new 9ff6c12e-5e5d-4f2b-ae6d-03501cab300c 2 2026-02-20T13:04:11.029 INFO:teuthology.orchestra.run.trial185.stderr:2026-02-20T13:04:11.022+0000 7f36c25ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:11.032 INFO:teuthology.orchestra.run.trial185.stderr:2026-02-20T13:04:11.028+0000 7f36c25ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:11.070 INFO:teuthology.orchestra.run.trial185.stdout:2 2026-02-20T13:04:11.079 DEBUG:teuthology.orchestra.run.trial185:> sudo ceph --cluster ceph osd new c1614689-ba2f-4f07-96f8-01f357c540da 3 2026-02-20T13:04:11.153 INFO:teuthology.orchestra.run.trial185.stderr:2026-02-20T13:04:11.146+0000 7f99ef85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:11.156 INFO:teuthology.orchestra.run.trial185.stderr:2026-02-20T13:04:11.152+0000 7f99ef85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:11.194 INFO:teuthology.orchestra.run.trial185.stdout:3 2026-02-20T13:04:11.202 DEBUG:teuthology.orchestra.run.trial114:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-20T13:04:11.229 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T13:04:11.230 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T13:04:11.271 INFO:tasks.ceph.osd.0:Started 2026-02-20T13:04:11.271 DEBUG:teuthology.orchestra.run.trial114:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-20T13:04:11.300 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T13:04:11.300 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T13:04:11.342 INFO:tasks.ceph.osd.1:Started 2026-02-20T13:04:11.343 DEBUG:teuthology.orchestra.run.trial185:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-20T13:04:11.372 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T13:04:11.373 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T13:04:11.414 INFO:tasks.ceph.osd.2:Started 2026-02-20T13:04:11.415 DEBUG:teuthology.orchestra.run.trial185:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-20T13:04:11.444 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T13:04:11.445 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-20T13:04:11.487 INFO:tasks.ceph.osd.3:Started 2026-02-20T13:04:11.487 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T13:04:11.563 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:11.557+0000 7efd4c4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:11.567 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:11.564+0000 7efd4c4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:11.601 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:11.601 INFO:teuthology.orchestra.run.trial114.stdout:{"epoch":7,"fsid":"f76fe516-b7c8-4f96-a042-60844867d70e","created":"2026-02-20T13:04:09.314490+0000","modified":"2026-02-20T13:04:11.191375+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T13:04:11.191375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"005814e5-2d77-4b80-83a7-ec319b0825d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9655ff9-1fda-4405-a69a-c1096d0cbf93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9ff6c12e-5e5d-4f2b-ae6d-03501cab300c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1614689-ba2f-4f07-96f8-01f357c540da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:04:11.611 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T13:04:11.611 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T13:04:12.014 DEBUG:teuthology.orchestra.run.trial114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T13:04:12.081 INFO:teuthology.misc.health.trial114.stderr:2026-02-20T13:04:12.076+0000 7f54d6be4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:12.084 INFO:teuthology.misc.health.trial114.stderr:2026-02-20T13:04:12.081+0000 7f54d6be4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:12.116 INFO:teuthology.misc.health.trial114.stdout: 2026-02-20T13:04:12.117 INFO:teuthology.misc.health.trial114.stdout:{"epoch":7,"fsid":"f76fe516-b7c8-4f96-a042-60844867d70e","created":"2026-02-20T13:04:09.314490+0000","modified":"2026-02-20T13:04:11.191375+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T13:04:11.191375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"005814e5-2d77-4b80-83a7-ec319b0825d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c9655ff9-1fda-4405-a69a-c1096d0cbf93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9ff6c12e-5e5d-4f2b-ae6d-03501cab300c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1614689-ba2f-4f07-96f8-01f357c540da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:04:12.123 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-20T13:04:12.570 INFO:tasks.ceph.mgr.x.trial185.stderr:2026-02-20T13:04:12.566+0000 7ff1eb091640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T13:04:18.526 DEBUG:teuthology.orchestra.run.trial114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T13:04:18.595 INFO:teuthology.misc.health.trial114.stderr:2026-02-20T13:04:18.590+0000 7fe3ae17e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:18.597 INFO:teuthology.misc.health.trial114.stderr:2026-02-20T13:04:18.594+0000 7fe3ae17e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:18.708 INFO:teuthology.misc.health.trial114.stdout: 2026-02-20T13:04:18.708 INFO:teuthology.misc.health.trial114.stdout:{"epoch":11,"fsid":"f76fe516-b7c8-4f96-a042-60844867d70e","created":"2026-02-20T13:04:09.314490+0000","modified":"2026-02-20T13:04:18.695790+0000","last_up_change":"2026-02-20T13:04:18.695790+0000","last_in_change":"2026-02-20T13:04:11.191375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"005814e5-2d77-4b80-83a7-ec319b0825d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6800","nonce":2279604613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6803","nonce":2279604613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6804","nonce":2279604613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6805","nonce":2279604613}]},"public_addr":"10.20.193.114:6800/2279604613","cluster_addr":"10.20.193.114:6803/2279604613","heartbeat_back_addr":"10.20.193.114:6804/2279604613","heartbeat_front_addr":"10.20.193.114:6805/2279604613","state":["exists","up"]},{"osd":1,"uuid":"c9655ff9-1fda-4405-a69a-c1096d0cbf93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6802","nonce":3889648622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6801","nonce":3889648622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6810","nonce":3889648622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6811","nonce":3889648622}]},"public_addr":"10.20.193.114:6802/3889648622","cluster_addr":"10.20.193.114:6801/3889648622","heartbeat_back_addr":"10.20.193.114:6810/3889648622","heartbeat_front_addr":"10.20.193.114:6811/3889648622","state":["exists","up"]},{"osd":2,"uuid":"9ff6c12e-5e5d-4f2b-ae6d-03501cab300c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6807","nonce":4031258513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6808","nonce":4031258513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6804","nonce":4031258513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6805","nonce":4031258513}]},"public_addr":"10.20.193.185:6807/4031258513","cluster_addr":"10.20.193.185:6808/4031258513","heartbeat_back_addr":"10.20.193.185:6804/4031258513","heartbeat_front_addr":"10.20.193.185:6805/4031258513","state":["exists","up"]},{"osd":3,"uuid":"c1614689-ba2f-4f07-96f8-01f357c540da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6803","nonce":71477561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6802","nonce":71477561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6809","nonce":71477561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6806","nonce":71477561}]},"public_addr":"10.20.193.185:6803/71477561","cluster_addr":"10.20.193.185:6802/71477561","heartbeat_back_addr":"10.20.193.185:6809/71477561","heartbeat_front_addr":"10.20.193.185:6806/71477561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:04:18.718 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-20T13:04:18.718 INFO:tasks.ceph:Creating RBD pool 2026-02-20T13:04:18.718 DEBUG:teuthology.orchestra.run.trial114:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T13:04:18.793 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:18.786+0000 7fa22dbcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:18.796 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:18.793+0000 7fa22dbcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:19.705 INFO:teuthology.orchestra.run.trial114.stderr:pool 'rbd' created 2026-02-20T13:04:19.717 DEBUG:teuthology.orchestra.run.trial114:> rbd --cluster ceph pool init rbd 2026-02-20T13:04:19.756 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:19.752+0000 7f4d9160e240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:19.756 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:19.752+0000 7f4d9160e240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:19.759 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:19.755+0000 7f4d9160e240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:22.740 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T13:04:22.741 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T13:04:22.741 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T13:04:22.858 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:22.851+0000 7fd76f65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:22.860 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:22.856+0000 7fd76f65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:22.972 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:22.982 INFO:teuthology.orchestra.run.trial114.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-20T13:04:22.982 INFO:tasks.ceph_manager:config epoch is 1 2026-02-20T13:04:22.982 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T13:04:22.982 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T13:04:22.983 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T13:04:23.061 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.054+0000 7fc8ef76f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.063 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.059+0000 7fc8ef76f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.208 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:23.217 INFO:teuthology.orchestra.run.trial114.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6800","nonce":446485590},{"type":"v1","addr":"10.20.193.185:6801","nonce":446485590}]},"active_addr":"10.20.193.185:6801/446485590","active_change":"2026-02-20T13:04:11.560878+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.185:0","nonce":22015071}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.185:0","nonce":2677505721}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.185:0","nonce":1494354760}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.185:0","nonce":2663551474}]}]} 2026-02-20T13:04:23.223 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T13:04:23.223 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T13:04:23.224 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T13:04:23.300 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.294+0000 7f7a66bfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.302 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.298+0000 7f7a66bfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.417 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:23.417 INFO:teuthology.orchestra.run.trial114.stdout:{"epoch":15,"fsid":"f76fe516-b7c8-4f96-a042-60844867d70e","created":"2026-02-20T13:04:09.314490+0000","modified":"2026-02-20T13:04:22.712820+0000","last_up_change":"2026-02-20T13:04:18.695790+0000","last_in_change":"2026-02-20T13:04:11.191375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T13:04:18.908643+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-20T13:04:19.582758+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"005814e5-2d77-4b80-83a7-ec319b0825d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6800","nonce":2279604613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6803","nonce":2279604613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6804","nonce":2279604613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6805","nonce":2279604613}]},"public_addr":"10.20.193.114:6800/2279604613","cluster_addr":"10.20.193.114:6803/2279604613","heartbeat_back_addr":"10.20.193.114:6804/2279604613","heartbeat_front_addr":"10.20.193.114:6805/2279604613","state":["exists","up"]},{"osd":1,"uuid":"c9655ff9-1fda-4405-a69a-c1096d0cbf93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6802","nonce":3889648622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6801","nonce":3889648622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6810","nonce":3889648622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6811","nonce":3889648622}]},"public_addr":"10.20.193.114:6802/3889648622","cluster_addr":"10.20.193.114:6801/3889648622","heartbeat_back_addr":"10.20.193.114:6810/3889648622","heartbeat_front_addr":"10.20.193.114:6811/3889648622","state":["exists","up"]},{"osd":2,"uuid":"9ff6c12e-5e5d-4f2b-ae6d-03501cab300c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6807","nonce":4031258513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6808","nonce":4031258513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6804","nonce":4031258513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6805","nonce":4031258513}]},"public_addr":"10.20.193.185:6807/4031258513","cluster_addr":"10.20.193.185:6808/4031258513","heartbeat_back_addr":"10.20.193.185:6804/4031258513","heartbeat_front_addr":"10.20.193.185:6805/4031258513","state":["exists","up"]},{"osd":3,"uuid":"c1614689-ba2f-4f07-96f8-01f357c540da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6803","nonce":71477561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6802","nonce":71477561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6809","nonce":71477561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6806","nonce":71477561}]},"public_addr":"10.20.193.185:6803/71477561","cluster_addr":"10.20.193.185:6802/71477561","heartbeat_back_addr":"10.20.193.185:6809/71477561","heartbeat_front_addr":"10.20.193.185:6806/71477561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:04:23.427 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T13:04:23.427 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T13:04:23.501 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.495+0000 7f5f130cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.504 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.500+0000 7f5f130cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.616 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:23.617 INFO:teuthology.orchestra.run.trial114.stdout:{"epoch":15,"fsid":"f76fe516-b7c8-4f96-a042-60844867d70e","created":"2026-02-20T13:04:09.314490+0000","modified":"2026-02-20T13:04:22.712820+0000","last_up_change":"2026-02-20T13:04:18.695790+0000","last_in_change":"2026-02-20T13:04:11.191375+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T13:04:18.908643+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-20T13:04:19.582758+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"005814e5-2d77-4b80-83a7-ec319b0825d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6800","nonce":2279604613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6803","nonce":2279604613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6804","nonce":2279604613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6805","nonce":2279604613}]},"public_addr":"10.20.193.114:6800/2279604613","cluster_addr":"10.20.193.114:6803/2279604613","heartbeat_back_addr":"10.20.193.114:6804/2279604613","heartbeat_front_addr":"10.20.193.114:6805/2279604613","state":["exists","up"]},{"osd":1,"uuid":"c9655ff9-1fda-4405-a69a-c1096d0cbf93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6802","nonce":3889648622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6801","nonce":3889648622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6810","nonce":3889648622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.114:6811","nonce":3889648622}]},"public_addr":"10.20.193.114:6802/3889648622","cluster_addr":"10.20.193.114:6801/3889648622","heartbeat_back_addr":"10.20.193.114:6810/3889648622","heartbeat_front_addr":"10.20.193.114:6811/3889648622","state":["exists","up"]},{"osd":2,"uuid":"9ff6c12e-5e5d-4f2b-ae6d-03501cab300c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6807","nonce":4031258513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6808","nonce":4031258513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6804","nonce":4031258513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6805","nonce":4031258513}]},"public_addr":"10.20.193.185:6807/4031258513","cluster_addr":"10.20.193.185:6808/4031258513","heartbeat_back_addr":"10.20.193.185:6804/4031258513","heartbeat_front_addr":"10.20.193.185:6805/4031258513","state":["exists","up"]},{"osd":3,"uuid":"c1614689-ba2f-4f07-96f8-01f357c540da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6803","nonce":71477561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6802","nonce":71477561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6809","nonce":71477561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.185:6806","nonce":71477561}]},"public_addr":"10.20.193.185:6803/71477561","cluster_addr":"10.20.193.185:6802/71477561","heartbeat_back_addr":"10.20.193.185:6809/71477561","heartbeat_front_addr":"10.20.193.185:6806/71477561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T13:04:23.627 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T13:04:23.627 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T13:04:23.628 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T13:04:23.628 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-20T13:04:23.713 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.706+0000 7f67fa30b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.714 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.706+0000 7f44eae8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.714 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.707+0000 7f3a3450b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.714 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.707+0000 7fdf0eecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.716 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.712+0000 7f44eae8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.716 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.712+0000 7f67fa30b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.716 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.712+0000 7f3a3450b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.717 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.713+0000 7fdf0eecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.735 INFO:teuthology.orchestra.run.trial114.stdout:47244640261 2026-02-20T13:04:23.736 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T13:04:23.737 INFO:teuthology.orchestra.run.trial114.stdout:47244640261 2026-02-20T13:04:23.737 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T13:04:23.738 INFO:teuthology.orchestra.run.trial114.stdout:42949672966 2026-02-20T13:04:23.739 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T13:04:23.740 INFO:teuthology.orchestra.run.trial114.stdout:42949672966 2026-02-20T13:04:23.740 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T13:04:23.859 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.852+0000 7f720b45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.859 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.852+0000 7f8f24b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.860 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.854+0000 7f174c5b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.861 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.854+0000 7feaa4b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.861 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.857+0000 7f8f24b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.862 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.857+0000 7f720b45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.863 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.859+0000 7feaa4b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.863 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:23.859+0000 7f174c5b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:23.976 INFO:teuthology.orchestra.run.trial114.stdout:47244640261 2026-02-20T13:04:23.979 INFO:teuthology.orchestra.run.trial114.stdout:47244640261 2026-02-20T13:04:23.986 INFO:teuthology.orchestra.run.trial114.stdout:42949672966 2026-02-20T13:04:23.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.3 2026-02-20T13:04:23.987 DEBUG:teuthology.parallel:result is None 2026-02-20T13:04:23.989 INFO:teuthology.orchestra.run.trial114.stdout:42949672966 2026-02-20T13:04:23.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.0 2026-02-20T13:04:23.992 DEBUG:teuthology.parallel:result is None 2026-02-20T13:04:23.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2026-02-20T13:04:23.997 DEBUG:teuthology.parallel:result is None 2026-02-20T13:04:24.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2026-02-20T13:04:24.000 DEBUG:teuthology.parallel:result is None 2026-02-20T13:04:24.001 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T13:04:24.001 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:04:24.117 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.110+0000 7f7e5f81a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:24.119 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.116+0000 7f7e5f81a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:24.231 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:24.231 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:04:24.239 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T13:04:23.727563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":3576,"kb_used_data":3576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208663048,"statfs":{"total":213674622976,"available":213670961152,"internally_reserved":0,"allocated":3661824,"data_stored":3661824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.721721+0000","last_change":"2026-02-20T13:04:22.726600+0000","last_active":"2026-02-20T13:04:22.721721+0000","last_peered":"2026-02-20T13:04:22.721721+0000","last_clean":"2026-02-20T13:04:22.721721+0000","last_became_active":"2026-02-20T13:04:20.754605+0000","last_became_peered":"2026-02-20T13:04:20.754605+0000","last_unstale":"2026-02-20T13:04:22.721721+0000","last_undegraded":"2026-02-20T13:04:22.721721+0000","last_fullsized":"2026-02-20T13:04:22.721721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724169+0000","last_change":"2026-02-20T13:04:22.726258+0000","last_active":"2026-02-20T13:04:22.724169+0000","last_peered":"2026-02-20T13:04:22.724169+0000","last_clean":"2026-02-20T13:04:22.724169+0000","last_became_active":"2026-02-20T13:04:20.753930+0000","last_became_peered":"2026-02-20T13:04:20.753930+0000","last_unstale":"2026-02-20T13:04:22.724169+0000","last_undegraded":"2026-02-20T13:04:22.724169+0000","last_fullsized":"2026-02-20T13:04:22.724169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723062+0000","last_change":"2026-02-20T13:04:22.725609+0000","last_active":"2026-02-20T13:04:22.723062+0000","last_peered":"2026-02-20T13:04:22.723062+0000","last_clean":"2026-02-20T13:04:22.723062+0000","last_became_active":"2026-02-20T13:04:20.747942+0000","last_became_peered":"2026-02-20T13:04:20.747942+0000","last_unstale":"2026-02-20T13:04:22.723062+0000","last_undegraded":"2026-02-20T13:04:22.723062+0000","last_fullsized":"2026-02-20T13:04:22.723062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724232+0000","last_change":"2026-02-20T13:04:22.726325+0000","last_active":"2026-02-20T13:04:22.724232+0000","last_peered":"2026-02-20T13:04:22.724232+0000","last_clean":"2026-02-20T13:04:22.724232+0000","last_became_active":"2026-02-20T13:04:20.764454+0000","last_became_peered":"2026-02-20T13:04:20.764454+0000","last_unstale":"2026-02-20T13:04:22.724232+0000","last_undegraded":"2026-02-20T13:04:22.724232+0000","last_fullsized":"2026-02-20T13:04:22.724232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723887+0000","last_change":"2026-02-20T13:04:20.794473+0000","last_active":"2026-02-20T13:04:22.723887+0000","last_peered":"2026-02-20T13:04:22.723887+0000","last_clean":"2026-02-20T13:04:22.723887+0000","last_became_active":"2026-02-20T13:04:20.784850+0000","last_became_peered":"2026-02-20T13:04:20.784850+0000","last_unstale":"2026-02-20T13:04:22.723887+0000","last_undegraded":"2026-02-20T13:04:22.723887+0000","last_fullsized":"2026-02-20T13:04:22.723887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723273+0000","last_change":"2026-02-20T13:04:22.725464+0000","last_active":"2026-02-20T13:04:22.723273+0000","last_peered":"2026-02-20T13:04:22.723273+0000","last_clean":"2026-02-20T13:04:22.723273+0000","last_became_active":"2026-02-20T13:04:20.753888+0000","last_became_peered":"2026-02-20T13:04:20.753888+0000","last_unstale":"2026-02-20T13:04:22.723273+0000","last_undegraded":"2026-02-20T13:04:22.723273+0000","last_fullsized":"2026-02-20T13:04:22.723273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724655+0000","last_change":"2026-02-20T13:04:22.724655+0000","last_active":"2026-02-20T13:04:22.724655+0000","last_peered":"2026-02-20T13:04:22.724655+0000","last_clean":"2026-02-20T13:04:22.724655+0000","last_became_active":"2026-02-20T13:04:20.752273+0000","last_became_peered":"2026-02-20T13:04:20.752273+0000","last_unstale":"2026-02-20T13:04:22.724655+0000","last_undegraded":"2026-02-20T13:04:22.724655+0000","last_fullsized":"2026-02-20T13:04:22.724655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.722963+0000","last_change":"2026-02-20T13:04:22.726688+0000","last_active":"2026-02-20T13:04:22.722963+0000","last_peered":"2026-02-20T13:04:22.722963+0000","last_clean":"2026-02-20T13:04:22.722963+0000","last_became_active":"2026-02-20T13:04:20.749427+0000","last_became_peered":"2026-02-20T13:04:20.749427+0000","last_unstale":"2026-02-20T13:04:22.722963+0000","last_undegraded":"2026-02-20T13:04:22.722963+0000","last_fullsized":"2026-02-20T13:04:22.722963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.721862+0000","last_change":"2026-02-20T13:04:22.725032+0000","last_active":"2026-02-20T13:04:22.721862+0000","last_peered":"2026-02-20T13:04:22.721862+0000","last_clean":"2026-02-20T13:04:22.721862+0000","last_became_active":"2026-02-20T13:04:20.767651+0000","last_became_peered":"2026-02-20T13:04:20.767651+0000","last_unstale":"2026-02-20T13:04:22.721862+0000","last_undegraded":"2026-02-20T13:04:22.721862+0000","last_fullsized":"2026-02-20T13:04:22.721862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253407232,"internally_reserved":0,"allocated":2560000,"data_stored":2560000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1072,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165584,"statfs":{"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":352,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166304,"statfs":{"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:04:24.241 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:04:24.316 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.310+0000 7fc2866cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:24.319 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.315+0000 7fc2866cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:24.432 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:24.433 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:04:24.442 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T13:04:23.727563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":3576,"kb_used_data":3576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208663048,"statfs":{"total":213674622976,"available":213670961152,"internally_reserved":0,"allocated":3661824,"data_stored":3661824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.721721+0000","last_change":"2026-02-20T13:04:22.726600+0000","last_active":"2026-02-20T13:04:22.721721+0000","last_peered":"2026-02-20T13:04:22.721721+0000","last_clean":"2026-02-20T13:04:22.721721+0000","last_became_active":"2026-02-20T13:04:20.754605+0000","last_became_peered":"2026-02-20T13:04:20.754605+0000","last_unstale":"2026-02-20T13:04:22.721721+0000","last_undegraded":"2026-02-20T13:04:22.721721+0000","last_fullsized":"2026-02-20T13:04:22.721721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724169+0000","last_change":"2026-02-20T13:04:22.726258+0000","last_active":"2026-02-20T13:04:22.724169+0000","last_peered":"2026-02-20T13:04:22.724169+0000","last_clean":"2026-02-20T13:04:22.724169+0000","last_became_active":"2026-02-20T13:04:20.753930+0000","last_became_peered":"2026-02-20T13:04:20.753930+0000","last_unstale":"2026-02-20T13:04:22.724169+0000","last_undegraded":"2026-02-20T13:04:22.724169+0000","last_fullsized":"2026-02-20T13:04:22.724169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723062+0000","last_change":"2026-02-20T13:04:22.725609+0000","last_active":"2026-02-20T13:04:22.723062+0000","last_peered":"2026-02-20T13:04:22.723062+0000","last_clean":"2026-02-20T13:04:22.723062+0000","last_became_active":"2026-02-20T13:04:20.747942+0000","last_became_peered":"2026-02-20T13:04:20.747942+0000","last_unstale":"2026-02-20T13:04:22.723062+0000","last_undegraded":"2026-02-20T13:04:22.723062+0000","last_fullsized":"2026-02-20T13:04:22.723062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724232+0000","last_change":"2026-02-20T13:04:22.726325+0000","last_active":"2026-02-20T13:04:22.724232+0000","last_peered":"2026-02-20T13:04:22.724232+0000","last_clean":"2026-02-20T13:04:22.724232+0000","last_became_active":"2026-02-20T13:04:20.764454+0000","last_became_peered":"2026-02-20T13:04:20.764454+0000","last_unstale":"2026-02-20T13:04:22.724232+0000","last_undegraded":"2026-02-20T13:04:22.724232+0000","last_fullsized":"2026-02-20T13:04:22.724232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723887+0000","last_change":"2026-02-20T13:04:20.794473+0000","last_active":"2026-02-20T13:04:22.723887+0000","last_peered":"2026-02-20T13:04:22.723887+0000","last_clean":"2026-02-20T13:04:22.723887+0000","last_became_active":"2026-02-20T13:04:20.784850+0000","last_became_peered":"2026-02-20T13:04:20.784850+0000","last_unstale":"2026-02-20T13:04:22.723887+0000","last_undegraded":"2026-02-20T13:04:22.723887+0000","last_fullsized":"2026-02-20T13:04:22.723887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723273+0000","last_change":"2026-02-20T13:04:22.725464+0000","last_active":"2026-02-20T13:04:22.723273+0000","last_peered":"2026-02-20T13:04:22.723273+0000","last_clean":"2026-02-20T13:04:22.723273+0000","last_became_active":"2026-02-20T13:04:20.753888+0000","last_became_peered":"2026-02-20T13:04:20.753888+0000","last_unstale":"2026-02-20T13:04:22.723273+0000","last_undegraded":"2026-02-20T13:04:22.723273+0000","last_fullsized":"2026-02-20T13:04:22.723273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724655+0000","last_change":"2026-02-20T13:04:22.724655+0000","last_active":"2026-02-20T13:04:22.724655+0000","last_peered":"2026-02-20T13:04:22.724655+0000","last_clean":"2026-02-20T13:04:22.724655+0000","last_became_active":"2026-02-20T13:04:20.752273+0000","last_became_peered":"2026-02-20T13:04:20.752273+0000","last_unstale":"2026-02-20T13:04:22.724655+0000","last_undegraded":"2026-02-20T13:04:22.724655+0000","last_fullsized":"2026-02-20T13:04:22.724655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.722963+0000","last_change":"2026-02-20T13:04:22.726688+0000","last_active":"2026-02-20T13:04:22.722963+0000","last_peered":"2026-02-20T13:04:22.722963+0000","last_clean":"2026-02-20T13:04:22.722963+0000","last_became_active":"2026-02-20T13:04:20.749427+0000","last_became_peered":"2026-02-20T13:04:20.749427+0000","last_unstale":"2026-02-20T13:04:22.722963+0000","last_undegraded":"2026-02-20T13:04:22.722963+0000","last_fullsized":"2026-02-20T13:04:22.722963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.721862+0000","last_change":"2026-02-20T13:04:22.725032+0000","last_active":"2026-02-20T13:04:22.721862+0000","last_peered":"2026-02-20T13:04:22.721862+0000","last_clean":"2026-02-20T13:04:22.721862+0000","last_became_active":"2026-02-20T13:04:20.767651+0000","last_became_peered":"2026-02-20T13:04:20.767651+0000","last_unstale":"2026-02-20T13:04:22.721862+0000","last_undegraded":"2026-02-20T13:04:22.721862+0000","last_fullsized":"2026-02-20T13:04:22.721862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253407232,"internally_reserved":0,"allocated":2560000,"data_stored":2560000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1072,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165584,"statfs":{"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":352,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166304,"statfs":{"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:04:24.443 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T13:04:24.444 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T13:04:24.444 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T13:04:24.444 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T13:04:24.519 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.513+0000 7f316885a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:24.521 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.518+0000 7f31675d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:24.659 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:24.659 INFO:teuthology.orchestra.run.trial114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T13:04:24.668 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T13:04:24.669 INFO:teuthology.run_tasks:Running task thrashosds... 2026-02-20T13:04:24.679 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T13:04:24.679 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-perezjos-crimson-only-12-02-2026-PR66245'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}} 2026-02-20T13:04:24.680 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T13:04:24.680 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2026-02-20T13:04:24.758 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.749+0000 7f074390b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:24.760 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.756+0000 7f074390b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:24.883 INFO:tasks.thrashosds:Beginning thrashosds... 2026-02-20T13:04:24.883 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T13:04:24.884 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:04:24.960 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.954+0000 7f6c52f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:24.963 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:24.959+0000 7f6c52f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.074 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:25.074 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:04:25.083 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T13:04:23.727563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":3576,"kb_used_data":3576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208663048,"statfs":{"total":213674622976,"available":213670961152,"internally_reserved":0,"allocated":3661824,"data_stored":3661824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.721721+0000","last_change":"2026-02-20T13:04:22.726600+0000","last_active":"2026-02-20T13:04:22.721721+0000","last_peered":"2026-02-20T13:04:22.721721+0000","last_clean":"2026-02-20T13:04:22.721721+0000","last_became_active":"2026-02-20T13:04:20.754605+0000","last_became_peered":"2026-02-20T13:04:20.754605+0000","last_unstale":"2026-02-20T13:04:22.721721+0000","last_undegraded":"2026-02-20T13:04:22.721721+0000","last_fullsized":"2026-02-20T13:04:22.721721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724169+0000","last_change":"2026-02-20T13:04:22.726258+0000","last_active":"2026-02-20T13:04:22.724169+0000","last_peered":"2026-02-20T13:04:22.724169+0000","last_clean":"2026-02-20T13:04:22.724169+0000","last_became_active":"2026-02-20T13:04:20.753930+0000","last_became_peered":"2026-02-20T13:04:20.753930+0000","last_unstale":"2026-02-20T13:04:22.724169+0000","last_undegraded":"2026-02-20T13:04:22.724169+0000","last_fullsized":"2026-02-20T13:04:22.724169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723062+0000","last_change":"2026-02-20T13:04:22.725609+0000","last_active":"2026-02-20T13:04:22.723062+0000","last_peered":"2026-02-20T13:04:22.723062+0000","last_clean":"2026-02-20T13:04:22.723062+0000","last_became_active":"2026-02-20T13:04:20.747942+0000","last_became_peered":"2026-02-20T13:04:20.747942+0000","last_unstale":"2026-02-20T13:04:22.723062+0000","last_undegraded":"2026-02-20T13:04:22.723062+0000","last_fullsized":"2026-02-20T13:04:22.723062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724232+0000","last_change":"2026-02-20T13:04:22.726325+0000","last_active":"2026-02-20T13:04:22.724232+0000","last_peered":"2026-02-20T13:04:22.724232+0000","last_clean":"2026-02-20T13:04:22.724232+0000","last_became_active":"2026-02-20T13:04:20.764454+0000","last_became_peered":"2026-02-20T13:04:20.764454+0000","last_unstale":"2026-02-20T13:04:22.724232+0000","last_undegraded":"2026-02-20T13:04:22.724232+0000","last_fullsized":"2026-02-20T13:04:22.724232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723887+0000","last_change":"2026-02-20T13:04:20.794473+0000","last_active":"2026-02-20T13:04:22.723887+0000","last_peered":"2026-02-20T13:04:22.723887+0000","last_clean":"2026-02-20T13:04:22.723887+0000","last_became_active":"2026-02-20T13:04:20.784850+0000","last_became_peered":"2026-02-20T13:04:20.784850+0000","last_unstale":"2026-02-20T13:04:22.723887+0000","last_undegraded":"2026-02-20T13:04:22.723887+0000","last_fullsized":"2026-02-20T13:04:22.723887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723273+0000","last_change":"2026-02-20T13:04:22.725464+0000","last_active":"2026-02-20T13:04:22.723273+0000","last_peered":"2026-02-20T13:04:22.723273+0000","last_clean":"2026-02-20T13:04:22.723273+0000","last_became_active":"2026-02-20T13:04:20.753888+0000","last_became_peered":"2026-02-20T13:04:20.753888+0000","last_unstale":"2026-02-20T13:04:22.723273+0000","last_undegraded":"2026-02-20T13:04:22.723273+0000","last_fullsized":"2026-02-20T13:04:22.723273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724655+0000","last_change":"2026-02-20T13:04:22.724655+0000","last_active":"2026-02-20T13:04:22.724655+0000","last_peered":"2026-02-20T13:04:22.724655+0000","last_clean":"2026-02-20T13:04:22.724655+0000","last_became_active":"2026-02-20T13:04:20.752273+0000","last_became_peered":"2026-02-20T13:04:20.752273+0000","last_unstale":"2026-02-20T13:04:22.724655+0000","last_undegraded":"2026-02-20T13:04:22.724655+0000","last_fullsized":"2026-02-20T13:04:22.724655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.722963+0000","last_change":"2026-02-20T13:04:22.726688+0000","last_active":"2026-02-20T13:04:22.722963+0000","last_peered":"2026-02-20T13:04:22.722963+0000","last_clean":"2026-02-20T13:04:22.722963+0000","last_became_active":"2026-02-20T13:04:20.749427+0000","last_became_peered":"2026-02-20T13:04:20.749427+0000","last_unstale":"2026-02-20T13:04:22.722963+0000","last_undegraded":"2026-02-20T13:04:22.722963+0000","last_fullsized":"2026-02-20T13:04:22.722963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.721862+0000","last_change":"2026-02-20T13:04:22.725032+0000","last_active":"2026-02-20T13:04:22.721862+0000","last_peered":"2026-02-20T13:04:22.721862+0000","last_clean":"2026-02-20T13:04:22.721862+0000","last_became_active":"2026-02-20T13:04:20.767651+0000","last_became_peered":"2026-02-20T13:04:20.767651+0000","last_unstale":"2026-02-20T13:04:22.721862+0000","last_undegraded":"2026-02-20T13:04:22.721862+0000","last_fullsized":"2026-02-20T13:04:22.721862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253407232,"internally_reserved":0,"allocated":2560000,"data_stored":2560000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1072,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165584,"statfs":{"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":352,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166304,"statfs":{"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:04:25.084 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:04:25.157 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.151+0000 7f32d22cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.160 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.156+0000 7f32d22cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.270 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:25.270 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:04:25.279 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T13:04:23.727563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":3576,"kb_used_data":3576,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208663048,"statfs":{"total":213674622976,"available":213670961152,"internally_reserved":0,"allocated":3661824,"data_stored":3661824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.721721+0000","last_change":"2026-02-20T13:04:22.726600+0000","last_active":"2026-02-20T13:04:22.721721+0000","last_peered":"2026-02-20T13:04:22.721721+0000","last_clean":"2026-02-20T13:04:22.721721+0000","last_became_active":"2026-02-20T13:04:20.754605+0000","last_became_peered":"2026-02-20T13:04:20.754605+0000","last_unstale":"2026-02-20T13:04:22.721721+0000","last_undegraded":"2026-02-20T13:04:22.721721+0000","last_fullsized":"2026-02-20T13:04:22.721721+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724169+0000","last_change":"2026-02-20T13:04:22.726258+0000","last_active":"2026-02-20T13:04:22.724169+0000","last_peered":"2026-02-20T13:04:22.724169+0000","last_clean":"2026-02-20T13:04:22.724169+0000","last_became_active":"2026-02-20T13:04:20.753930+0000","last_became_peered":"2026-02-20T13:04:20.753930+0000","last_unstale":"2026-02-20T13:04:22.724169+0000","last_undegraded":"2026-02-20T13:04:22.724169+0000","last_fullsized":"2026-02-20T13:04:22.724169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723062+0000","last_change":"2026-02-20T13:04:22.725609+0000","last_active":"2026-02-20T13:04:22.723062+0000","last_peered":"2026-02-20T13:04:22.723062+0000","last_clean":"2026-02-20T13:04:22.723062+0000","last_became_active":"2026-02-20T13:04:20.747942+0000","last_became_peered":"2026-02-20T13:04:20.747942+0000","last_unstale":"2026-02-20T13:04:22.723062+0000","last_undegraded":"2026-02-20T13:04:22.723062+0000","last_fullsized":"2026-02-20T13:04:22.723062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724232+0000","last_change":"2026-02-20T13:04:22.726325+0000","last_active":"2026-02-20T13:04:22.724232+0000","last_peered":"2026-02-20T13:04:22.724232+0000","last_clean":"2026-02-20T13:04:22.724232+0000","last_became_active":"2026-02-20T13:04:20.764454+0000","last_became_peered":"2026-02-20T13:04:20.764454+0000","last_unstale":"2026-02-20T13:04:22.724232+0000","last_undegraded":"2026-02-20T13:04:22.724232+0000","last_fullsized":"2026-02-20T13:04:22.724232+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723887+0000","last_change":"2026-02-20T13:04:20.794473+0000","last_active":"2026-02-20T13:04:22.723887+0000","last_peered":"2026-02-20T13:04:22.723887+0000","last_clean":"2026-02-20T13:04:22.723887+0000","last_became_active":"2026-02-20T13:04:20.784850+0000","last_became_peered":"2026-02-20T13:04:20.784850+0000","last_unstale":"2026-02-20T13:04:22.723887+0000","last_undegraded":"2026-02-20T13:04:22.723887+0000","last_fullsized":"2026-02-20T13:04:22.723887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.723273+0000","last_change":"2026-02-20T13:04:22.725464+0000","last_active":"2026-02-20T13:04:22.723273+0000","last_peered":"2026-02-20T13:04:22.723273+0000","last_clean":"2026-02-20T13:04:22.723273+0000","last_became_active":"2026-02-20T13:04:20.753888+0000","last_became_peered":"2026-02-20T13:04:20.753888+0000","last_unstale":"2026-02-20T13:04:22.723273+0000","last_undegraded":"2026-02-20T13:04:22.723273+0000","last_fullsized":"2026-02-20T13:04:22.723273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724655+0000","last_change":"2026-02-20T13:04:22.724655+0000","last_active":"2026-02-20T13:04:22.724655+0000","last_peered":"2026-02-20T13:04:22.724655+0000","last_clean":"2026-02-20T13:04:22.724655+0000","last_became_active":"2026-02-20T13:04:20.752273+0000","last_became_peered":"2026-02-20T13:04:20.752273+0000","last_unstale":"2026-02-20T13:04:22.724655+0000","last_undegraded":"2026-02-20T13:04:22.724655+0000","last_fullsized":"2026-02-20T13:04:22.724655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.722963+0000","last_change":"2026-02-20T13:04:22.726688+0000","last_active":"2026-02-20T13:04:22.722963+0000","last_peered":"2026-02-20T13:04:22.722963+0000","last_clean":"2026-02-20T13:04:22.722963+0000","last_became_active":"2026-02-20T13:04:20.749427+0000","last_became_peered":"2026-02-20T13:04:20.749427+0000","last_unstale":"2026-02-20T13:04:22.722963+0000","last_undegraded":"2026-02-20T13:04:22.722963+0000","last_fullsized":"2026-02-20T13:04:22.722963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.721862+0000","last_change":"2026-02-20T13:04:22.725032+0000","last_active":"2026-02-20T13:04:22.721862+0000","last_peered":"2026-02-20T13:04:22.721862+0000","last_clean":"2026-02-20T13:04:22.721862+0000","last_became_active":"2026-02-20T13:04:20.767651+0000","last_became_peered":"2026-02-20T13:04:20.767651+0000","last_unstale":"2026-02-20T13:04:22.721862+0000","last_undegraded":"2026-02-20T13:04:22.721862+0000","last_fullsized":"2026-02-20T13:04:22.721862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253407232,"internally_reserved":0,"allocated":2560000,"data_stored":2560000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1072,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165584,"statfs":{"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":352,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166304,"statfs":{"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417558016,"internally_reserved":0,"allocated":1097728,"data_stored":1097728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:04:25.281 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T13:04:25.281 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-20T13:04:25.356 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.350+0000 7f6b7265a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.359 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.355+0000 7f6b7265a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.470 INFO:teuthology.orchestra.run.trial114.stdout:epoch 15 2026-02-20T13:04:25.470 INFO:teuthology.orchestra.run.trial114.stdout:fsid f76fe516-b7c8-4f96-a042-60844867d70e 2026-02-20T13:04:25.470 INFO:teuthology.orchestra.run.trial114.stdout:created 2026-02-20T13:04:09.314490+0000 2026-02-20T13:04:25.470 INFO:teuthology.orchestra.run.trial114.stdout:modified 2026-02-20T13:04:22.712820+0000 2026-02-20T13:04:25.471 INFO:teuthology.orchestra.run.trial114.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-20T13:04:25.471 INFO:teuthology.orchestra.run.trial114.stdout:crush_version 5 2026-02-20T13:04:25.471 INFO:teuthology.orchestra.run.trial114.stdout:full_ratio 0.95 2026-02-20T13:04:25.471 INFO:teuthology.orchestra.run.trial114.stdout:backfillfull_ratio 0.9 2026-02-20T13:04:25.471 INFO:teuthology.orchestra.run.trial114.stdout:nearfull_ratio 0.85 2026-02-20T13:04:25.471 INFO:teuthology.orchestra.run.trial114.stdout:require_min_compat_client luminous 2026-02-20T13:04:25.472 INFO:teuthology.orchestra.run.trial114.stdout:min_compat_client jewel 2026-02-20T13:04:25.472 INFO:teuthology.orchestra.run.trial114.stdout:require_osd_release tentacle 2026-02-20T13:04:25.472 INFO:teuthology.orchestra.run.trial114.stdout:stretch_mode_enabled false 2026-02-20T13:04:25.472 INFO:teuthology.orchestra.run.trial114.stdout:allow_crimson=true 2026-02-20T13:04:25.472 INFO:teuthology.orchestra.run.trial114.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.00 2026-02-20T13:04:25.472 INFO:teuthology.orchestra.run.trial114.stdout: removed_snaps_queue [2~1] 2026-02-20T13:04:25.473 INFO:teuthology.orchestra.run.trial114.stdout:pool 2 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-20T13:04:25.473 INFO:teuthology.orchestra.run.trial114.stdout:max_osd 4 2026-02-20T13:04:25.473 INFO:teuthology.orchestra.run.trial114.stdout:osd.0 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.114:6800/2279604613 v2:10.20.193.114:6803/2279604613 exists,up 005814e5-2d77-4b80-83a7-ec319b0825d5 2026-02-20T13:04:25.473 INFO:teuthology.orchestra.run.trial114.stdout:osd.1 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.114:6802/3889648622 v2:10.20.193.114:6801/3889648622 exists,up c9655ff9-1fda-4405-a69a-c1096d0cbf93 2026-02-20T13:04:25.473 INFO:teuthology.orchestra.run.trial114.stdout:osd.2 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.185:6807/4031258513 v2:10.20.193.185:6808/4031258513 exists,up 9ff6c12e-5e5d-4f2b-ae6d-03501cab300c 2026-02-20T13:04:25.473 INFO:teuthology.orchestra.run.trial114.stdout:osd.3 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.185:6803/71477561 v2:10.20.193.185:6802/71477561 exists,up c1614689-ba2f-4f07-96f8-01f357c540da 2026-02-20T13:04:25.479 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.114:6800/2279604613 v2:10.20.193.114:6803/2279604613 exists,up 005814e5-2d77-4b80-83a7-ec319b0825d5', 'osd.1 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.114:6802/3889648622 v2:10.20.193.114:6801/3889648622 exists,up c9655ff9-1fda-4405-a69a-c1096d0cbf93', 'osd.2 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.185:6807/4031258513 v2:10.20.193.185:6808/4031258513 exists,up 9ff6c12e-5e5d-4f2b-ae6d-03501cab300c', 'osd.3 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.185:6803/71477561 v2:10.20.193.185:6802/71477561 exists,up c1614689-ba2f-4f07-96f8-01f357c540da'] 2026-02-20T13:04:25.479 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2026-02-20T13:04:25.555 INFO:teuthology.orchestra.run.trial114.stdout:{ 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "name": "mon.a", 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "cluster": "ceph", 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "admin_socket_mode": "", 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "auth_client_required": "cephx, none", 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "auth_cluster_required": "cephx", 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "auth_debug": "true", 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-20T13:04:25.556 INFO:teuthology.orchestra.run.trial114.stdout: "auth_mon_ticket_ttl": "660.000000", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "auth_service_required": "cephx", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "auth_service_ticket_ttl": "240.000000", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "auth_supported": "cephx", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_aio": "true", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_aio_poll_ms": "250", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_aio_reap_max": "16", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_async_discard": "false", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-20T13:04:25.557 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_async_discard_threads": "0", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_block_size": "4096", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_debug_aio": "false", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_debug_discard_sleep": "0", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_debug_inflight_ios": "false", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_enable_discard": "false", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_flock_retry": "3", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_inject_crash": "0", 2026-02-20T13:04:25.558 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_ioring": "false", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_ioring_hipri": "false", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_max_discard_length": "2147483648", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bdev_type": "", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_alloc_size": "1048576", 2026-02-20T13:04:25.559 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_allocator": "hybrid", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_buffered_io": "true", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_check_for_zeros": "false", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_compact_log_sync": "false", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_max_log_runway": "4194304", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_max_prefetch": "1048576", 2026-02-20T13:04:25.560 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_min_flush_size": "524288", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_min_log_runway": "1048576", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_replay_recovery": "false", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_sync_write": "false", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_allocation_from_file": "true", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_allocator": "hybrid", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-20T13:04:25.561 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_async_db_compaction": "true", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_bdev_label_multi": "true", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_create": "true", 2026-02-20T13:04:25.562 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_db_create": "false", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_db_path": "", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_db_size": "0", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_path": "", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_preallocate_file": "false", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_size": "107374182400", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_wal_create": "false", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_wal_path": "", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_block_wal_size": "100663296", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_bluefs": "true", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-20T13:04:25.563 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_autotune": "true", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-20T13:04:25.564 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_size": "0", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cache_type": "2q", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_clone_cow": "true", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-20T13:04:25.565 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_compression_mode": "none", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_csum_type": "crc32c", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_freelist": "false", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-20T13:04:25.566 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_small_allocations": "0", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_default_buffered_read": "true", 2026-02-20T13:04:25.567 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_default_buffered_write": "false", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fail_eio": "false", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-20T13:04:25.568 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_on_mount": "false", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_on_umount": "false", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-20T13:04:25.569 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_ignore_data_csum": "false", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_log_op_age": "5.000000", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_max_alloc_size": "0", 2026-02-20T13:04:25.570 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_max_blob_size": "0", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_max_deferred_txc": "32", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_min_alloc_size": "0", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_nid_prealloc": "1024", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_onode_segment_size": "0", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-20T13:04:25.571 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_retry_disk_reads": "3", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_rocksdb_cf": "true", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-20T13:04:25.572 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_spdk_mem": "512", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-20T13:04:25.573 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_tracing": "false", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_write_v2": "false", 2026-02-20T13:04:25.574 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_write_v2_random": "false", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "bluestore_zero_block_detection": "false", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "breakpad": "false", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "ceph_assert_supresssions": "", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-20T13:04:25.575 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephx_cluster_require_signatures": "false", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephx_cluster_require_version": "2", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephx_require_signatures": "false", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephx_require_version": "2", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephx_service_require_signatures": "false", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephx_service_require_version": "2", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "cephx_sign_messages": "true", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "chdir": "", 2026-02-20T13:04:25.576 INFO:teuthology.orchestra.run.trial114.stdout: "client_acl_type": "", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_asio_thread_count": "2", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_cache_mid": "0.750000", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_cache_size": "16384", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_caps_release_delay": "5", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_check_pool_perm": "true", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_debug_force_sync_read": "false", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_debug_getattr_caps": "false", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_debug_inject_features": "", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_debug_inject_tick_delay": "0", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_die_on_failed_remount": "false", 2026-02-20T13:04:25.577 INFO:teuthology.orchestra.run.trial114.stdout: "client_dirsize_rbytes": "true", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_force_lazyio": "false", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_fs": "", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_fscrypt_as": "true", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_inject_release_failure": "false", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_inject_write_delay_secs": "0", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_max_inline_size": "4096", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_mds_namespace": "", 2026-02-20T13:04:25.578 INFO:teuthology.orchestra.run.trial114.stdout: "client_metadata": "", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_mount_gid": "-1", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_mount_timeout": "300", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_mount_uid": "-1", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_mountpoint": "/", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_notify_timeout": "10", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_oc": "true", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_oc_max_dirty": "104857600", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_oc_max_objects": "1000", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_oc_size": "209715200", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_oc_target_dirty": "8388608", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_permissions": "true", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_quota": "true", 2026-02-20T13:04:25.579 INFO:teuthology.orchestra.run.trial114.stdout: "client_quota_df": "true", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_readahead_max_bytes": "0", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_readahead_max_periods": "4", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_readahead_min": "131072", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_reconnect_stale": "false", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_shutdown_timeout": "30", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_snapdir": ".snap", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_tick_interval": "1", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_trace": "", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_try_dentry_invalidate": "false", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_use_faked_inos": "false", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "client_use_random_mds": "false", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "clog_to_graylog": "false", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-20T13:04:25.580 INFO:teuthology.orchestra.run.trial114.stdout: "clog_to_graylog_port": "12201", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "clog_to_monitors": "default=true", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "clog_to_syslog": "false", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "clog_to_syslog_level": "info", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "cluster_addr": "-", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "cluster_network": "", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "cluster_network_interface": "", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "compressor_zlib_isal": "false", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "compressor_zlib_level": "5", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "compressor_zlib_winsize": "-15", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "compressor_zstd_level": "1", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-20T13:04:25.581 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_allow_pg_split": "true", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_bluestore_cpu_set": "", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_bluestore_num_threads": "6", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_cpu_num": "0", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_cpu_set": "", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_osd_obc_lru_size": "512", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_osd_stat_interval": "0", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_poll_mode": "false", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crush_location": "", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crush_location_hook": "", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "crush_location_hook_timeout": "10", 2026-02-20T13:04:25.582 INFO:teuthology.orchestra.run.trial114.stdout: "d4n_writecache_enabled": "false", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "daemonize": "false", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "daos_pool": "tank", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_alienstore": "0/5", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_allow_any_pool_priority": "false", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_asok": "1/5", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_asok_assert_abort": "false", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_asserts_on_shutdown": "true", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_auth": "20/20", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_bdev": "1/3", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_bluefs": "1/5", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_bluestore": "1/5", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_bluestore_compression": "1/5", 2026-02-20T13:04:25.583 INFO:teuthology.orchestra.run.trial114.stdout: "debug_buffer": "0/1", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_ceph_dedup": "0/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_ceph_exporter": "1/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_cephfs_mirror": "0/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_cephsqlite": "0/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_client": "0/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_compressor": "1/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_context": "0/1", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_crimson_interrupt": "0/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_crush": "1/1", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_crypto": "1/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_cyanstore": "0/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_deliberately_leak_memory": "false", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_disable_randomized_ping": "false", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_dpdk": "1/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_eventtrace": "1/5", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_filer": "0/1", 2026-02-20T13:04:25.584 INFO:teuthology.orchestra.run.trial114.stdout: "debug_filestore": "1/3", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_finisher": "1/1", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_fuse": "1/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_heartbeat_testing_span": "0", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_heartbeatmap": "1/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_javaclient": "1/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_journal": "1/3", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_journaler": "0/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_kstore": "1/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_lockdep": "0/1", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mclock": "1/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mds": "1/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mds_balancer": "1/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mds_locker": "1/5", 2026-02-20T13:04:25.585 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mds_log": "1/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mds_log_expire": "1/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mds_migrator": "1/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mds_quiesce": "3/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_memstore": "1/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mgr": "2/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mgrc": "1/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_mon": "20/20", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_monc": "0/10", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_ms": "1/1", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_none": "0/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_objclass": "0/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_objectcacher": "0/5", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_objecter": "0/1", 2026-02-20T13:04:25.586 INFO:teuthology.orchestra.run.trial114.stdout: "debug_optracker": "0/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_osd": "1/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_paxos": "20/20", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_perfcounter": "1/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_prioritycache": "1/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rados": "0/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rbd": "0/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rbd_mirror": "0/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rbd_pwl": "0/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rbd_replay": "0/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_refs": "0/0", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_reserver": "1/1", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw": "1/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_access": "1/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_datacache": "1/5", 2026-02-20T13:04:25.587 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_dbstore": "1/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_dedup": "1/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_flight": "1/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_notification": "1/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_restore": "1/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rgw_sync": "1/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_rocksdb": "4/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore": "0/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_backref": "0/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_cache": "0/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_cleaner": "0/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_device": "0/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_epm": "0/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_fixedkv_tree": "0/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_journal": "0/5", 2026-02-20T13:04:25.588 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_lba": "0/5", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_odata": "0/5", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_omap": "0/5", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_onode": "0/5", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_t": "0/5", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_seastore_tm": "0/5", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_striper": "0/1", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_test": "0/5", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_throttle": "1/1", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_timer": "0/1", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_tp": "0/5", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "debug_trace": "1/5", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "device_failure_prediction_mode": "none", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "ec_extent_cache_size": "10485760", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "ec_pdw_write_mode": "0", 2026-02-20T13:04:25.589 INFO:teuthology.orchestra.run.trial114.stdout: "enable_availability_tracking": "false", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "err_to_graylog": "false", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "err_to_journald": "false", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "err_to_stderr": "true", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "err_to_syslog": "false", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "event_tracing": "false", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "exporter_addr": "0.0.0.0", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "exporter_cert_file": "", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "exporter_http_port": "9926", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "exporter_key_file": "", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "exporter_prio_limit": "5", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "exporter_sort_metrics": "true", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "exporter_stats_period": "5", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "fake_statfs_for_testing": "0", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "fatal_signal_handlers": "true", 2026-02-20T13:04:25.590 INFO:teuthology.orchestra.run.trial114.stdout: "filer_max_purge_ops": "10", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filer_max_truncate_ops": "128", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_apply_finisher_threads": "1", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_blackhole": "false", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_btrfs_clone_range": "true", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_btrfs_snap": "true", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_caller_concurrency": "10", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_collect_device_partition_information": "true", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_commit_timeout": "600.000000", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_debug_inject_read_err": "false", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_debug_omap_check": "false", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_debug_verify_split": "false", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_dump_file": "", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-20T13:04:25.591 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_fadvise": "true", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_fail_eio": "true", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_fd_cache_shards": "16", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_fd_cache_size": "128", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_fiemap": "false", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_fiemap_threshold": "4096", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_inject_stall": "0", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_journal_parallel": "false", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_journal_trailing": "false", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_journal_writeahead": "false", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_kill_at": "0", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-20T13:04:25.592 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_inline_xattrs": "0", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_xattr_value_size": "0", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_merge_threshold": "-10", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_odsync_write": "false", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_omap_backend": "rocksdb", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_omap_backend_path": "", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_ondisk_finisher_threads": "1", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_op_thread_timeout": "60", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_op_threads": "2", 2026-02-20T13:04:25.593 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_punch_hole": "false", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_queue_max_ops": "50", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_seek_data_hole": "false", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_sloppy_crc": "false", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_splice": "false", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_split_multiple": "2", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_split_rand_factor": "20", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_update_to": "1000", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-20T13:04:25.594 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_enable": "true", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_xfs_extsize": "false", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "filestore_zfs_snap": "false", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "fio_dir": "/tmp/fio", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "fsid": "f76fe516-b7c8-4f96-a042-60844867d70e", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_allow_other": "true", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_atomic_o_trunc": "true", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_big_writes": "true", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_debug": "false", 2026-02-20T13:04:25.595 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_default_permissions": "false", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_disable_pagecache": "false", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_max_write": "0", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_multithreaded": "true", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_require_active_mds": "true", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_set_user_groups": "true", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_splice_move": "true", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_splice_read": "true", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_splice_write": "true", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "fuse_use_invalidate_cb": "true", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "gss_target_name": "ceph", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "heartbeat_file": "", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "heartbeat_inject_failure": "0", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "heartbeat_interval": "5", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "host": "trial114", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-20T13:04:25.596 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "inject_early_sigterm": "false", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "jaeger_agent_port": "6799", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "jaeger_tracing_enable": "false", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "journal_aio": "true", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "journal_align_min_size": "65536", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "journal_block_align": "true", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "journal_block_size": "4096", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "journal_dio": "true", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "journal_discard": "false", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "journal_force_aio": "false", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "journal_ignore_corruption": "false", 2026-02-20T13:04:25.597 INFO:teuthology.orchestra.run.trial114.stdout: "journal_max_write_bytes": "10485760", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journal_max_write_entries": "100", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journal_replay_from": "0", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journal_write_header_frequency": "0", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journal_zero_on_create": "false", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journaler_prefetch_periods": "10", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journaler_prezero_periods": "5", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "journaler_write_head_interval": "15", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "key": "", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "keyfile": "", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "librados_thread_count": "2", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "lockdep": "false", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "lockdep_force_backtrace": "false", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "log_coarse_timestamps": "true", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "log_flush_on_exit": "false", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "log_graylog_host": "127.0.0.1", 2026-02-20T13:04:25.598 INFO:teuthology.orchestra.run.trial114.stdout: "log_graylog_port": "12201", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "log_max_new": "1000", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "log_max_recent": "10000", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "log_stderr_prefix": "", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "log_stop_at_utilization": "0.970000", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "log_to_file": "true", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "log_to_graylog": "false", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "log_to_journald": "false", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "log_to_stderr": "false", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "log_to_syslog": "false", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "max_rotating_auth_attempts": "10", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_action_on_write_error": "1", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_allow_async_dirops": "true", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_allow_batched_ops": "true", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_alternate_name_max": "8192", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_asio_thread_count": "2", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_export_pin": "true", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_fragment_dirs": "true", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_fragment_interval": "5", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-20T13:04:25.599 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_interval": "10", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_max": "-1", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_max_until": "-1", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_merge_size": "50", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_midchunk": "0.300000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_min_start": "0.200000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_minchunk": "0.001000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_mode": "0", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_need_max": "1.200000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_need_min": "0.800000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_overload_epochs": "2", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_split_bits": "3", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_split_size": "10000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_target_decay": "10.000000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_beacon_grace": "15.000000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_beacon_interval": "4.000000", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-20T13:04:25.600 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_mid": "0.700000", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_quiesce_delay": "0", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_release_free_interval": "10", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_reservation": "0.050000", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_trim_interval": "1", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cache_trim_threshold": "262144", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_client_prealloc_inos": "1000", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_connect_bootstrapping": "false", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_damage_table_max_entries": "10000", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_debug_auth_pins": "false", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_debug_frag": "false", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_debug_scatterstat": "false", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_debug_subtrees": "false", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_decay_halflife": "5.000000", 2026-02-20T13:04:25.601 INFO:teuthology.orchestra.run.trial114.stdout: "mds_default_dir_hash": "2", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_defer_session_stale": "true", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_deny_all_reconnect": "false", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_dir_keys_per_op": "16384", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_dir_max_commit_size": "10", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_dir_max_entries": "0", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_dir_prefetch": "true", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_dump_cache_on_map": "false", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_early_reply": "true", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_enable_op_tracker": "true", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_enforce_unique_name": "true", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_export_ephemeral_random": "true", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-20T13:04:25.602 INFO:teuthology.orchestra.run.trial114.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_health_summarize_threshold": "10", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_inject_health_dummy": "false", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_inject_migrator_session_race": "false", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_join_fs": "", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_journal_format": "1", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_create_at": "0", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_dirfrag_at": "0", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_export_at": "0", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_import_at": "0", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_journal_at": "0", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_journal_expire_at": "0", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_journal_replay_at": "0", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_link_at": "0", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_mdstable_at": "0", 2026-02-20T13:04:25.603 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_openc_at": "0", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_rename_at": "0", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_kill_shutdown_at": "0", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_event_large_threshold": "524288", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_events_per_segment": "1024", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_max_events": "-1", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_max_segments": "128", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_pause": "false", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_segment_size": "0", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_trim_threshold": "128", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_log_warn_factor": "2.000000", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_caps_per_client": "1048576", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_completed_flushes": "100000", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_completed_requests": "100000", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_export_size": "20971520", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_file_recover": "32", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_purge_files": "64", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_purge_ops": "8192", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-20T13:04:25.604 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_max_snaps_per_dir": "100", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_metrics_update_interval": "2", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_min_caps_per_client": "100", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_min_caps_working_set": "10000", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_numa_node": "-1", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_op_complaint_time": "30.000000", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_op_history_duration": "600", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_op_history_size": "20", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_op_history_slow_op_size": "20", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_op_log_threshold": "5", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_ping_grace": "15", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_ping_interval": "5", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_recall_max_caps": "30000", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_recall_warning_threshold": "262144", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_replay_interval": "1.000000", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-20T13:04:25.605 INFO:teuthology.orchestra.run.trial114.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_root_ino_gid": "0", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_root_ino_uid": "0", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_scrub_stats_review_period": "1", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_shutdown_check": "0", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_skip_ino": "0", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_snap_max_uid": "4294967294", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_snap_min_uid": "0", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_snap_rstat": "false", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_standby_replay_damaged": "false", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_symlink_recovery": "true", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-20T13:04:25.606 INFO:teuthology.orchestra.run.trial114.stdout: "mds_thrash_exports": "0", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mds_thrash_fragments": "0", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mds_tick_interval": "5.000000", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mds_valgrind_exit": "false", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mds_verify_backtrace": "1", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mds_verify_scatter": "false", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mds_wipe_sessions": "false", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mempool_debug": "false", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "memstore_device_bytes": "1073741824", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "memstore_page_set": "false", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "memstore_page_size": "65536", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_client_bytes": "134217728", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_client_messages": "512", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_disabled_modules": "", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_enable_op_tracker": "true", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_max_pg_creating": "1024", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_max_pg_num_change": "128", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_mds_bytes": "134217728", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_mds_messages": "128", 2026-02-20T13:04:25.607 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_mon_bytes": "134217728", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_mon_messages": "128", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_op_history_duration": "600", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_op_history_size": "20", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_op_log_threshold": "5", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_osd_bytes": "536870912", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_osd_messages": "8192", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_pool": "true", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_standby_modules": "true", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_stats_period": "5", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_stats_threshold": "5", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_tick_period": "2", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_allow_pool_delete": "true", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_allow_pool_size_one": "true", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_auth_validate_all_caps": "true", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_bytes": "104857600", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_directed_command_retry": "2", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-20T13:04:25.608 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_hunt_on_resend": "true", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_hunt_parallel": "3", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_log_interval": "1.000000", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_ping_interval": "10.000000", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_client_target_rank": "-1", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_level": "debug", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_to_file": "true", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_to_journald": "false", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_compact_on_bootstrap": "false", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_compact_on_start": "false", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_compact_on_trim": "true", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-20T13:04:25.609 INFO:teuthology.orchestra.run.trial114.stdout: "mon_cpu_threads": "4", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_crush_min_required_version": "hammer", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_daemon_bytes": "419430400", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_data_avail_crit": "5", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_data_avail_warn": "5", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_data_size_warn": "16106127360", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_dump_json": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_dump_transactions": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_extra_checks": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_no_require_squid": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_down_added_grace": "180", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_down_mkfs_grace": "120", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_down_uptime_grace": "60", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_election_default_strategy": "1", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_election_timeout": "5.000000", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_elector_ping_divisor": "2", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-20T13:04:25.610 INFO:teuthology.orchestra.run.trial114.stdout: "mon_enable_op_tracker": "true", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_fake_pool_delete": "false", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_force_quorum_join": "false", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_globalid_prealloc": "10000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_health_detail_to_clog": "false", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_health_log_update_period": "5", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_health_max_detail": "50", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_health_to_clog": "true", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_health_to_clog_interval": "600", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_host": "10.20.193.114", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_host_override": "", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_initial_members": "", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_lease": "5.000000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_log_full_interval": "50", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_log_max": "10000", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_log_max_summary": "50", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_max_log_epochs": "500", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-20T13:04:25.611 INFO:teuthology.orchestra.run.trial114.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_max_osd": "10000", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_max_pg_per_osd": "10000", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_max_pool_pg_num": "65536", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_mds_force_trim_to": "0", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_mds_skip_sanity": "false", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_memory_autotune": "true", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_memory_target": "2147483648", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_mgr_beacon_grace": "30", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_mgr_digest_period": "5", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_mgr_inactive_grace": "60", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_mgr_mkfs_grace": "240", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_min_osdmap_epochs": "50", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_netsplit_grace_period": "9", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_op_complaint_time": "30", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_op_history_duration": "600", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_op_history_size": "20", 2026-02-20T13:04:25.612 INFO:teuthology.orchestra.run.trial114.stdout: "mon_op_history_slow_op_size": "20", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_op_log_threshold": "5", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_auto_mark_in": "false", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_cache_size": "500", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_down_out_interval": "600", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_force_trim_to": "0", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_min_down_reporters": "2", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-20T13:04:25.613 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_report_timeout": "900", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_reporter_subtree_level": "osd", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osdmap_full_prune_interval": "2", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osdmap_full_prune_min": "15", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_osdmap_full_prune_txsize": "2", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_pg_stuck_threshold": "60", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_probe_timeout": "2.000000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_reweight_max_change": "0.050000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_reweight_max_osds": "4", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_reweight_min_bytes_per_osd": "10", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_reweight_min_pgs_per_osd": "4", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_scrub_interval": "86400", 2026-02-20T13:04:25.614 INFO:teuthology.orchestra.run.trial114.stdout: "mon_scrub_max_keys": "100", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_scrub_timeout": "300", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_session_timeout": "300", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_smart_report_timeout": "5", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_stat_smooth_intervals": "6", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_stretch_pool_min_size": "2", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_stretch_pool_size": "4", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_sync_debug": "false", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_sync_provider_kill_at": "0", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_sync_requester_kill_at": "0", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_sync_timeout": "60.000000", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_target_pg_per_osd": "100", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_tick_interval": "5", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_timecheck_interval": "300.000000", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_use_min_delay_socket": "false", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_older_version_delay": "604800", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_filestore_osds": "false", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-20T13:04:25.615 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_misplaced": "false", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_older_version": "true", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_pool_no_redundancy": "false", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "monmap": "", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "motr_tracing_enabled": "false", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_op_threads": "3", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_cm": "false", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_device_name": "", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_dscp": "96", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_local_gid": "", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-20T13:04:25.616 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_port_num": "1", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_sl": "3", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_support_srq": "true", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_rdma_type": "ib", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_async_reap_threshold": "5", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_before_connect": "false", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_ipv4": "true", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_ipv6": "false", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_msgr1": "true", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_msgr2": "true", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_port_max": "7568", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_port_min": "6800", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_retry_count": "3", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_bind_retry_delay": "5", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_blackhole_client": "false", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_blackhole_mds": "false", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_blackhole_mgr": "false", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_blackhole_mon": "false", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_blackhole_osd": "false", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_client_mode": "crc", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_cluster_mode": "crc", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_cluster_type": "", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_compress_secure": "false", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_connection_idle_timeout": "900", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_connection_ready_timeout": "10", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_crc_data": "true", 2026-02-20T13:04:25.617 INFO:teuthology.orchestra.run.trial114.stdout: "ms_crc_header": "true", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_die_on_bad_msg": "false", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_die_on_bug": "true", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_die_on_old_message": "true", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_die_on_skipped_message": "false", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_coremask": "0xF", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_enable_tso": "true", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_hugepages": "", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_lro": "true", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_memory_channel": "4", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_pmd": "", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_port_id": "0", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_dump_on_send": "false", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_initial_backoff": "0.200000", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_inject_delay_max": "1.000000", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_inject_delay_type": "", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_inject_network_congestion": "0", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_inject_socket_failures": "0", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_learn_addr_from_peer": "true", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_max_accept_failures": "4", 2026-02-20T13:04:25.618 INFO:teuthology.orchestra.run.trial114.stdout: "ms_max_backoff": "15.000000", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_mon_client_mode": "crc", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_mon_cluster_mode": "crc", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_mon_service_mode": "crc", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_osd_compress_min_size": "1024", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_osd_compress_mode": "none", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_pq_min_cost": "65536", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_public_type": "", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_service_mode": "crc", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_tcp_listen_backlog": "512", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_tcp_nodelay": "true", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_tcp_rcvbuf": "0", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "ms_type": "async+posix", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "no_config_file": "false", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objecter_completion_locks_per_session": "32", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objecter_inflight_ops": "1024", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objecter_tick_interval": "5.000000", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objecter_timeout": "10.000000", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objectstore_blackhole": "false", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "openssl_conf": "", 2026-02-20T13:04:25.619 INFO:teuthology.orchestra.run.trial114.stdout: "osd_agent_delay_time": "5.000000", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_agent_hist_halflife": "1000", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_agent_max_low_ops": "2", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_agent_max_ops": "4", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_agent_slop": "0.020000", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_asio_thread_count": "2", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_async_recovery_min_cost": "100", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_backfill_scan_max": "512", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_backfill_scan_min": "64", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_backoff_on_degraded": "false", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_backoff_on_peering": "false", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_backoff_on_unfound": "true", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_beacon_report_interval": "300", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_bench_duration": "30", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_bench_max_block_size": "67108864", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_blkin_trace_all": "false", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_check_for_log_corruption": "false", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T13:04:25.620 INFO:teuthology.orchestra.run.trial114.stdout: "osd_class_update_on_start": "true", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_client_message_cap": "256", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_client_message_size_cap": "524288000", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_client_op_priority": "63", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_client_watch_timeout": "30", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_command_max_records": "256", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_compact_on_start": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_crush_chooseleaf_type": "0", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_crush_update_on_start": "true", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_crush_update_weight_set": "true", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_feed_pullee": "-1", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_misdirected_ops": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_no_acting_change": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_no_purge_strays": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_op_order": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_pg_log_writeout": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_shutdown": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-20T13:04:25.621 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_trim_objects": "false", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_verify_snaps": "false", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_debug_verify_stray_on_activate": "false", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_deep_scrub_keys": "1024", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_default_data_pool_replay_window": "5", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_default_notify_timeout": "30", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_delete_sleep": "0.000000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_discard_disconnected_ops": "true", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_ec_partial_reads": "true", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_enable_op_tracker": "true", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_fast_info": "true", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_fast_shutdown": "true", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-20T13:04:25.622 INFO:teuthology.orchestra.run.trial114.stdout: "osd_function_tracing": "false", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_heartbeat_grace": "20", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_heartbeat_interval": "6", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_heartbeat_min_peers": "10", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_heartbeat_min_size": "2000", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_heartbeat_stale": "600", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_hit_set_max_size": "100000", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_hit_set_min_size": "1000", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_journal_size": "5120", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_kill_backfill_at": "0", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_map_cache_size": "50", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_map_dedup": "true", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_map_message_max": "40", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_map_share_max_epochs": "40", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_attr_name_len": "100", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_attr_size": "0", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_backfills": "1", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_markdown_count": "5", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_markdown_period": "600", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_object_name_len": "2048", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_object_namespace_len": "256", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_object_size": "134217728", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_pg_blocked_by": "16", 2026-02-20T13:04:25.623 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_pg_log_entries": "10000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_pgls": "1024", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_push_cost": "8388608", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_push_objects": "10", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_scrubs": "3", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_trimming_pgs": "2", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_write_op_reply_len": "64", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_max_write_size": "90", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_profile": "balanced", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mclock_skip_benchmark": "false", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_memory_base": "805306368", 2026-02-20T13:04:25.624 INFO:teuthology.orchestra.run.trial114.stdout: "osd_memory_cache_min": "134217728", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_memory_target": "4294967296", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_memory_target_autotune": "false", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_min_pg_log_entries": "250", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_min_recovery_priority": "0", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mon_report_interval": "5", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_num_cache_shards": "32", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_num_op_tracker_shard": "32", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_numa_auto_affinity": "true", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_numa_node": "-1", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_numa_prefer_iface": "true", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_objecter_finishers": "1", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_objectstore": "bluestore", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_objectstore_fuse": "false", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_objectstore_tracing": "false", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_complaint_time": "30.000000", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_history_duration": "600", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_history_size": "20", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_history_slow_op_size": "20", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_log_threshold": "5", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_num_shards": "0", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_num_shards_hdd": "1", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_num_shards_ssd": "8", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-20T13:04:25.625 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_pq_min_cost": "65536", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_queue_cut_off": "high", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_op_thread_timeout": "15", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_open_classes_on_start": "true", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_os_flags": "0", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_peering_op_priority": "255", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_delete_cost": "1048576", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_delete_priority": "5", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_log_trim_max": "10000", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_log_trim_min": "100", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_crimson": "true", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-20T13:04:25.626 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_flags": "0", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_min_size": "2", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_pg_num": "32", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_pgp_num": "0", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_read_ratio": "70", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_size": "3", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_default_type": "replicated", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_push_per_object_cost": "1000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recover_clone_overlap": "true", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_cost": "20971520", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_max_active": "0", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_max_chunk": "8388608", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_max_single_start": "1", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_op_priority": "3", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_priority": "5", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_sleep": "0.000000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_requested_scrub_priority": "5", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-20T13:04:25.627 INFO:teuthology.orchestra.run.trial114.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_auto_repair": "false", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_begin_hour": "0", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_begin_week_day": "0", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_chunk_max": "15", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_chunk_min": "5", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_cost": "52428800", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_during_recovery": "false", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_end_hour": "0", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_end_week_day": "0", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_event_cost": "4096", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_invalid_stats": "true", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_load_threshold": "10.000000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_max_interval": "604800.000000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_max_preemptions": "5", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_priority": "5", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_retry_delay": "30", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_retry_trimming": "10", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_scrub_sleep": "0.000000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_skip_data_digest": "false", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_smart_report_timeout": "5", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_snap_trim_cost": "1048576", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_snap_trim_priority": "5", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-20T13:04:25.628 INFO:teuthology.orchestra.run.trial114.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_target_transaction_size": "30", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_tracing": "false", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_use_stale_snap": "false", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "osdc_blkin_trace_all": "false", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_kill_at": "0", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_max_join_drift": "10", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_min": "500", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_min_wait": "0.050000", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_propose_interval": "1.000000", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_service_trim_max": "500", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_service_trim_min": "10", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_stash_full_interval": "25", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_trim_max": "500", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "paxos_trim_min": "250", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "perf": "true", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "pool_availability_update_interval": "1.000000", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "public_addr": "-", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "public_addrv": "", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "public_bind_addr": "-", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "public_network": "", 2026-02-20T13:04:25.629 INFO:teuthology.orchestra.run.trial114.stdout: "public_network_interface": "", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "qat_compressor_busy_polling": "false", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "qat_compressor_enabled": "false", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "qat_compressor_session_max_number": "256", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rados_mon_op_timeout": "0", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rados_osd_op_timeout": "0", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rados_replica_read_policy": "default", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rados_tracing": "false", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_atime_update_interval": "60", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_balance_parent_reads": "false", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_balance_snap_reads": "false", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_blkin_trace_all": "false", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_cache": "true", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_cache_policy": "writearound", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_cache_size": "33554432", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_clone_copy_on_read": "false", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_compression_hint": "none", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_concurrent_management_ops": "10", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_clone_format": "auto", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_data_pool": "", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_features": "61", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_format": "2", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_map_options": "", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_order": "22", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_pool": "rbd", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_stripe_count": "0", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_default_stripe_unit": "0", 2026-02-20T13:04:25.630 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_enable_alloc_hint": "true", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_io_scheduler": "simple", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_order": "24", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_pool": "", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_journal_splay_width": "4", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_localize_parent_reads": "false", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_localize_snap_reads": "false", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-20T13:04:25.631 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_mtime_update_interval": "60", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_non_blocking_aio": "true", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_op_thread_timeout": "60", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_op_threads": "1", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_parent_cache_enabled": "false", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_plugins": "", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_bps_burst": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_bps_limit": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_exclude_ops": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_iops_burst": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_iops_limit": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-20T13:04:25.632 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_read_from_replica_policy": "default", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_skip_partial_discard": "true", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_tracing": "false", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_validate_names": "true", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rbd_validate_pool": "true", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "restapi_base_url": "", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "restapi_log_level": "", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_acl_grants_max_num": "100", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_admin_entry": "admin", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_asio_assert_yielding": "false", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_backend_store": "rados", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_barbican_url": "", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_beast_enable_async": "true", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_counters_cache": "false", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_eexist_override": "false", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_cache_enabled": "true", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_cache_expiry_interval": "900", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_cache_lru_size": "25000", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_config_store": "rados", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_content_length_compat": "false", 2026-02-20T13:04:25.633 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_copy_obj_progress": "true", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_cors_rules_max_num": "100", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_cross_domain_policy": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_kmip_addr": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_kmip_password": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_kmip_username": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_require_ssl": "true", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_addr": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_auth": "token", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_namespace": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_prefix": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_token_file": "", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_curl_buffersize": "524288", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_curl_low_speed_time": "300", 2026-02-20T13:04:25.634 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_data_log_changes_size": "1000", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_data_log_num_shards": "128", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_data_log_window": "30", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_disable_s3select": "false", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-20T13:04:25.635 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dns_name": "", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dns_s3website_name": "", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dynamic_resharding": "true", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_gc_threads": "true", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_lc_threads": "true", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_mdsearch": "true", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_ops_log": "false", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_quota_threads": "true", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_restore_threads": "true", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_static_website": "false", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enable_usage_log": "false", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_enforce_swift_acls": "true", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_exit_timeout_secs": "120", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_expose_bucket": "false", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_extended_http_attrs": "", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_filter": "none", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_frontends": "beast port=7480", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_gc_max_deferred": "50", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_gc_max_objs": "32", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_gc_processor_period": "3600", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_graceful_stop": "false", 2026-02-20T13:04:25.636 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_init_timeout": "300", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_kafka_connection_idle": "300", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_admin_domain": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_admin_password": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_admin_password_path": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_admin_project": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_admin_tenant": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_admin_user": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_barbican_domain": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_barbican_password": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_barbican_project": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_barbican_user": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_url": "", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lc_debug_interval": "-1", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lc_list_cnt": "1000", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lc_lock_max_time": "90", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lc_max_objs": "32", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lc_max_rules": "1000", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lc_max_worker": "3", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lc_thread_delay": "0", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ldap_dnattr": "uid", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-20T13:04:25.637 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ldap_searchfilter": "", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ldap_uri": "", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_log_http_headers": "", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_log_object_name_utc": "false", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lua_enable": "true", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_attr_name_len": "0", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_attr_size": "0", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_chunk_size": "4194304", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_control_aio": "8", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_listing_results": "5000", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_notify_retries": "10", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_put_param_size": "1048576", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_put_size": "5368709120", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_max_slo_entries": "1000", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_md_log_max_shards": "64", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_mp_lock_max_time": "600", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_max_gc": "300", 2026-02-20T13:04:25.638 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_num_async_rados_threads": "32", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_num_control_oids": "8", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_numa_node": "-1", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_objexp_chunk_size": "100", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_objexp_gc_interval": "600", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_op_thread_timeout": "600", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_op_tracing": "false", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_opa_token": "", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_opa_url": "", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_opa_verify_ssl": "true", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ops_log_rados": "false", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ops_log_socket_path": "", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_period_push_interval": "2.000000", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_posix_cache_lanes": "3", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_posix_cache_partitions": "3", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_print_continue": "true", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-20T13:04:25.639 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_rados_tracing": "false", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_ratelimit_interval": "60", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_realm": "", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_realm_id": "", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_region": "", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_request_uri": "", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_reshard_batch_size": "64", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_reshard_max_aio": "128", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_reshard_num_logs": "16", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_reshard_thread_interval": "600", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_resolve_cname": "false", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_restore_debug_interval": "-1", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_restore_lock_max_time": "90", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_restore_max_objs": "32", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_restore_processor_period": "900", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_run_sync_thread": "true", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_scheduler_type": "throttler", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_script_uri": "", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_service_provider_name": "", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sts_client_id": "", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sts_client_secret": "", 2026-02-20T13:04:25.640 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sts_entry": "sts", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sts_key": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sts_min_session_duration": "900", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sts_token_introspection_url": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_account_in_url": "false", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_auth_entry": "auth", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_auth_url": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_custom_header": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_need_stats": "true", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_tenant_name": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_token_expiration": "86400", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_url": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_url_prefix": "swift", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_lease_period": "120", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_thread_pool_size": "512", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_torrent_comment": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_torrent_createby": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_torrent_encoding": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_torrent_flag": "false", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_torrent_origin": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_torrent_tracker": "", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_trust_forwarded_https": "false", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_usage_log_key_transition": "true", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_usage_max_shards": "32", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_usage_max_user_shards": "1", 2026-02-20T13:04:25.641 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_use_opa_authz": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_counters_cache": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_max_buckets": "1000", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_policies_max_num": "100", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_user_unique_email": "true", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_verify_ssl": "true", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_zone": "", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_zone_id": "", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_zonegroup": "", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_zonegroup_id": "", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgwlc_auto_session_clear": "true", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_block_size": "4096", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_cache_size": "536870912", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_index_type": "binary_search", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_partition_filters": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_perf": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "run_dir": "/var/run/ceph", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_block_create": "true", 2026-02-20T13:04:25.642 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_cachepin_size_pershard": "2147483648", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_cachepin_type": "LRU", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_cold_tier_generations": "3", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_default_max_object_size": "16777216", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_device_size": "53687091200", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_full_integrity_check": "false", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_hot_tier_generations": "5", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_journal_batch_capacity": "16", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_main_device_type": "SSD", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_max_concurrent_transactions": "128", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_max_data_allocation_size": "0", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "seastore_segment_size": "67108864", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "service_unique_id": "", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "set_keepcaps": "false", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "setgroup": "", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "setuser": "", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "setuser_match_path": "", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "subv_metrics_window_interval": "30", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "thp": "false", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "threadpool_default_timeout": "60", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "throttler_perf_counter": "true", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "tmp_dir": "/tmp", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "uadk_compressor_enabled": "false", 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-20T13:04:25.643 INFO:teuthology.orchestra.run.trial114.stdout:} 2026-02-20T13:04:25.644 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2026-02-20T13:04:25.721 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.716+0000 7f9927a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.723 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.720+0000 7f9927a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.732 INFO:teuthology.orchestra.run.trial114.stdout:{} 2026-02-20T13:04:25.733 INFO:teuthology.orchestra.run.trial114.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-20T13:04:25.739 DEBUG:teuthology.orchestra.run.trial185:> type ceph-objectstore-tool 2026-02-20T13:04:25.755 INFO:teuthology.orchestra.run.trial185.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T13:04:25.756 DEBUG:teuthology.orchestra.run.trial114:> type ceph-objectstore-tool 2026-02-20T13:04:25.771 INFO:teuthology.orchestra.run.trial114.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T13:04:25.772 INFO:teuthology.run_tasks:Running task rados... 2026-02-20T13:04:25.790 INFO:tasks.rados:Beginning rados... 2026-02-20T13:04:25.790 INFO:tasks.rados:config is {'balance_reads': True, 'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 0, 'delete': 50, 'read': 100, 'rollback': 0, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-20T13:04:25.791 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-perezjos-crimson-only-12-02-2026-PR66245'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '26bc97655ae0056b78c14ab91d1307332bd6dfca'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}} 2026-02-20T13:04:25.791 INFO:tasks.rados:config is {'balance_reads': True, 'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 0, 'delete': 50, 'read': 100, 'rollback': 0, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-20T13:04:25.791 DEBUG:teuthology.run_tasks:Unwinding manager rados 2026-02-20T13:04:25.806 INFO:tasks.rados:joining rados 2026-02-20T13:04:25.806 INFO:tasks.thrashosds.thrasher:starting do_thrash 2026-02-20T13:04:25.806 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-20T13:04:25.806 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:04:25.806 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2, 3] 2026-02-20T13:04:25.807 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T13:04:25.807 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:04:25.807 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2026-02-20T13:04:25.807 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:04:25.808 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2026-02-20T13:04:25.808 INFO:tasks.rados:starting run 0 out of 1 2026-02-20T13:04:25.808 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-20T13:04:25.808 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-20T13:04:25.880 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T13:04:25.890 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.885+0000 7f82e4fcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.893 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.885+0000 7f4b00f62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.893 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.889+0000 7f82e4fcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:25.895 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:25.891+0000 7f4b00f62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:26.880 INFO:teuthology.orchestra.run.trial114.stderr:pool 'unique_pool_0' created 2026-02-20T13:04:26.893 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-20T13:04:27.015 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:27.006+0000 7ff16c45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:27.018 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:27.014+0000 7ff16c45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:27.884 INFO:teuthology.orchestra.run.trial114.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-20T13:04:28.897 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set unique_pool_0 pct_update_delay 5 2026-02-20T13:04:28.977 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:28.968+0000 7f4bce846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:28.980 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:28.976+0000 7f4bce846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:29.891 INFO:teuthology.orchestra.run.trial114.stderr:set pool 3 pct_update_delay to 5 2026-02-20T13:04:29.906 DEBUG:teuthology.orchestra.run.trial114:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph_test_rados --balance-reads --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 0 --op copy_from 0 --op write_excl 50 --pool unique_pool_0 2026-02-20T13:04:29.954 INFO:tasks.rados.rados.0.trial114.stdout:adding op weight read -> 100 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout:adding op weight write -> 50 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout:adding op weight delete -> 50 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout:adding op weight snap_create -> 50 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout:adding op weight snap_remove -> 50 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout:adding op weight write_excl -> 50 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout:ceph version 20.3.0-5312-g26bc9765 (26bc97655ae0056b78c14ab91d1307332bd6dfca) tentacle (dev - Debug) 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout:Configuration: 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout: Number of operations: 4000 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout: Number of objects: 50 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout: Max in flight operations: 16 2026-02-20T13:04:29.955 INFO:tasks.rados.rados.0.trial114.stdout: Object size (in bytes): 4000000 2026-02-20T13:04:29.956 INFO:tasks.rados.rados.0.trial114.stdout: Write stride min: 400000 2026-02-20T13:04:29.956 INFO:tasks.rados.rados.0.trial114.stdout: Write stride max: 800000 2026-02-20T13:04:30.880 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3] 2026-02-20T13:04:30.881 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:04:30.881 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:04:30.893 INFO:tasks.rados.rados.0.trial114.stdout:1: write initial oid 1 2026-02-20T13:04:30.893 INFO:tasks.rados.rados.0.trial114.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2026-02-20T13:04:30.897 INFO:tasks.rados.rados.0.trial114.stdout:1: writing trial11441570-1 from 416807 to 892056 tid 1 2026-02-20T13:04:30.902 INFO:tasks.rados.rados.0.trial114.stdout:1: writing trial11441570-1 from 1542129 to 2016807 tid 2 2026-02-20T13:04:30.902 INFO:tasks.rados.rados.0.trial114.stdout:2: write initial oid 2 2026-02-20T13:04:30.902 INFO:tasks.rados.rados.0.trial114.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2026-02-20T13:04:30.906 INFO:tasks.rados.rados.0.trial114.stdout:2: writing trial11441570-2 from 416807 to 892056 tid 1 2026-02-20T13:04:30.910 INFO:tasks.rados.rados.0.trial114.stdout:2: writing trial11441570-2 from 1542129 to 2016807 tid 2 2026-02-20T13:04:30.910 INFO:tasks.rados.rados.0.trial114.stdout:3: write initial oid 3 2026-02-20T13:04:30.910 INFO:tasks.rados.rados.0.trial114.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2026-02-20T13:04:30.914 INFO:tasks.rados.rados.0.trial114.stdout:3: writing trial11441570-3 from 433614 to 984112 tid 1 2026-02-20T13:04:30.918 INFO:tasks.rados.rados.0.trial114.stdout:3: writing trial11441570-3 from 1600611 to 2033614 tid 2 2026-02-20T13:04:30.919 INFO:tasks.rados.rados.0.trial114.stdout:4: write initial oid 4 2026-02-20T13:04:30.919 INFO:tasks.rados.rados.0.trial114.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2026-02-20T13:04:30.922 INFO:tasks.rados.rados.0.trial114.stdout:4: writing trial11441570-4 from 450421 to 1076168 tid 1 2026-02-20T13:04:30.926 INFO:tasks.rados.rados.0.trial114.stdout:4: writing trial11441570-4 from 1659093 to 2050421 tid 2 2026-02-20T13:04:30.927 INFO:tasks.rados.rados.0.trial114.stdout:5: write initial oid 5 2026-02-20T13:04:30.927 INFO:tasks.rados.rados.0.trial114.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2026-02-20T13:04:30.931 INFO:tasks.rados.rados.0.trial114.stdout:5: writing trial11441570-5 from 467228 to 1168224 tid 1 2026-02-20T13:04:30.935 INFO:tasks.rados.rados.0.trial114.stdout:5: writing trial11441570-5 from 1717575 to 2067228 tid 2 2026-02-20T13:04:30.935 INFO:tasks.rados.rados.0.trial114.stdout:6: write initial oid 6 2026-02-20T13:04:30.935 INFO:tasks.rados.rados.0.trial114.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2026-02-20T13:04:30.939 INFO:tasks.rados.rados.0.trial114.stdout:6: writing trial11441570-6 from 484035 to 1260280 tid 1 2026-02-20T13:04:30.943 INFO:tasks.rados.rados.0.trial114.stdout:6: writing trial11441570-6 from 2059704 to 2084035 tid 2 2026-02-20T13:04:30.943 INFO:tasks.rados.rados.0.trial114.stdout:7: write initial oid 7 2026-02-20T13:04:30.943 INFO:tasks.rados.rados.0.trial114.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2026-02-20T13:04:30.946 INFO:tasks.rados.rados.0.trial114.stdout:7: writing trial11441570-7 from 500842 to 952336 tid 1 2026-02-20T13:04:30.951 INFO:tasks.rados.rados.0.trial114.stdout:7: writing trial11441570-7 from 1718186 to 2100842 tid 2 2026-02-20T13:04:30.951 INFO:tasks.rados.rados.0.trial114.stdout:8: write initial oid 8 2026-02-20T13:04:30.951 INFO:tasks.rados.rados.0.trial114.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2026-02-20T13:04:30.955 INFO:tasks.rados.rados.0.trial114.stdout:8: writing trial11441570-8 from 517649 to 1044392 tid 1 2026-02-20T13:04:30.959 INFO:tasks.rados.rados.0.trial114.stdout:8: writing trial11441570-8 from 1776668 to 2117649 tid 2 2026-02-20T13:04:30.960 INFO:tasks.rados.rados.0.trial114.stdout:9: write initial oid 9 2026-02-20T13:04:30.960 INFO:tasks.rados.rados.0.trial114.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2026-02-20T13:04:30.961 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:30.955+0000 7fb71025a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:30.964 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:30.960+0000 7fb71025a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:30.965 INFO:tasks.rados.rados.0.trial114.stdout:9: writing trial11441570-9 from 534456 to 1252801 tid 1 2026-02-20T13:04:30.968 INFO:tasks.rados.rados.0.trial114.stdout:9: writing trial11441570-9 from 1951503 to 2134456 tid 2 2026-02-20T13:04:30.969 INFO:tasks.rados.rados.0.trial114.stdout:10: write initial oid 10 2026-02-20T13:04:30.969 INFO:tasks.rados.rados.0.trial114.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2026-02-20T13:04:30.974 INFO:tasks.rados.rados.0.trial114.stdout:10: writing trial11441570-10 from 551263 to 1344857 tid 1 2026-02-20T13:04:30.977 INFO:tasks.rados.rados.0.trial114.stdout:10: writing trial11441570-10 from 1893632 to 2151263 tid 2 2026-02-20T13:04:30.978 INFO:tasks.rados.rados.0.trial114.stdout:11: write initial oid 11 2026-02-20T13:04:30.978 INFO:tasks.rados.rados.0.trial114.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2026-02-20T13:04:30.981 INFO:tasks.rados.rados.0.trial114.stdout:11: writing trial11441570-11 from 568070 to 1036913 tid 1 2026-02-20T13:04:30.986 INFO:tasks.rados.rados.0.trial114.stdout:11: writing trial11441570-11 from 1552114 to 2168070 tid 2 2026-02-20T13:04:30.986 INFO:tasks.rados.rados.0.trial114.stdout:12: write initial oid 12 2026-02-20T13:04:30.986 INFO:tasks.rados.rados.0.trial114.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2026-02-20T13:04:30.990 INFO:tasks.rados.rados.0.trial114.stdout:12: writing trial11441570-12 from 584877 to 1128969 tid 1 2026-02-20T13:04:30.994 INFO:tasks.rados.rados.0.trial114.stdout:12: writing trial11441570-12 from 1610596 to 2172599 tid 2 2026-02-20T13:04:30.994 INFO:tasks.rados.rados.0.trial114.stdout:13: write initial oid 13 2026-02-20T13:04:30.995 INFO:tasks.rados.rados.0.trial114.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2026-02-20T13:04:30.999 INFO:tasks.rados.rados.0.trial114.stdout:13: writing trial11441570-13 from 601684 to 1221025 tid 1 2026-02-20T13:04:31.003 INFO:tasks.rados.rados.0.trial114.stdout:13: writing trial11441570-13 from 1669078 to 2201684 tid 2 2026-02-20T13:04:31.003 INFO:tasks.rados.rados.0.trial114.stdout:14: write initial oid 14 2026-02-20T13:04:31.003 INFO:tasks.rados.rados.0.trial114.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2026-02-20T13:04:31.008 INFO:tasks.rados.rados.0.trial114.stdout:14: writing trial11441570-14 from 618491 to 1313081 tid 1 2026-02-20T13:04:31.012 INFO:tasks.rados.rados.0.trial114.stdout:14: writing trial11441570-14 from 2011207 to 2218491 tid 2 2026-02-20T13:04:31.012 INFO:tasks.rados.rados.0.trial114.stdout:15: write initial oid 15 2026-02-20T13:04:31.012 INFO:tasks.rados.rados.0.trial114.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2026-02-20T13:04:31.017 INFO:tasks.rados.rados.0.trial114.stdout:15: writing trial11441570-15 from 635298 to 1405137 tid 1 2026-02-20T13:04:31.020 INFO:tasks.rados.rados.0.trial114.stdout:15: writing trial11441570-15 from 2069689 to 2235298 tid 2 2026-02-20T13:04:31.020 INFO:tasks.rados.rados.0.trial114.stdout:16: write initial oid 16 2026-02-20T13:04:31.020 INFO:tasks.rados.rados.0.trial114.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2026-02-20T13:04:31.024 INFO:tasks.rados.rados.0.trial114.stdout:16: writing trial11441570-16 from 652105 to 1097193 tid 1 2026-02-20T13:04:31.030 INFO:tasks.rados.rados.0.trial114.stdout:16: writing trial11441570-16 from 1728171 to 2181159 tid 2 2026-02-20T13:04:31.030 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:04:31.030 INFO:tasks.rados.rados.0.trial114.stdout:6: finishing write tid 1 to trial11441570-6 2026-02-20T13:04:31.030 INFO:tasks.rados.rados.0.trial114.stdout:6: finishing write tid 2 to trial11441570-6 2026-02-20T13:04:31.030 INFO:tasks.rados.rados.0.trial114.stdout:6: finishing write tid 3 to trial11441570-6 2026-02-20T13:04:31.030 INFO:tasks.rados.rados.0.trial114.stdout:6: finishing write tid 4 to trial11441570-6 2026-02-20T13:04:31.030 INFO:tasks.rados.rados.0.trial114.stdout:6: oid 6 updating version 0 to 1 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:6: oid 6 updating version 1 to 3 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:6: oid 6 version 3 is already newer than 3 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:9: finishing write tid 1 to trial11441570-9 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:9: finishing write tid 2 to trial11441570-9 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:9: finishing write tid 3 to trial11441570-9 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:9: finishing write tid 4 to trial11441570-9 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:9: oid 9 updating version 0 to 4 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:9: oid 9 updating version 4 to 6 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:9: oid 9 version 6 is already newer than 6 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 9 v 6 (ObjNum 8 snap 0 seq_num 8) dirty exists 2026-02-20T13:04:31.031 INFO:tasks.rados.rados.0.trial114.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:12: finishing write tid 1 to trial11441570-12 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:12: finishing write tid 2 to trial11441570-12 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:12: finishing write tid 3 to trial11441570-12 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:12: finishing write tid 4 to trial11441570-12 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:12: oid 12 updating version 0 to 9 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:12: oid 12 version 9 is already newer than 7 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:12: oid 12 version 9 is already newer than 9 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 12 v 9 (ObjNum 11 snap 0 seq_num 11) dirty exists 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:6: done (15 left) 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:9: done (14 left) 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:12: done (13 left) 2026-02-20T13:04:31.032 INFO:tasks.rados.rados.0.trial114.stdout:17: write initial oid 17 2026-02-20T13:04:31.033 INFO:tasks.rados.rados.0.trial114.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2026-02-20T13:04:31.034 INFO:tasks.rados.rados.0.trial114.stdout:17: writing trial11441570-17 from 668912 to 1305602 tid 1 2026-02-20T13:04:31.038 INFO:tasks.rados.rados.0.trial114.stdout:17: writing trial11441570-17 from 1903006 to 2268912 tid 2 2026-02-20T13:04:31.038 INFO:tasks.rados.rados.0.trial114.stdout:18: write initial oid 18 2026-02-20T13:04:31.038 INFO:tasks.rados.rados.0.trial114.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2026-02-20T13:04:31.043 INFO:tasks.rados.rados.0.trial114.stdout:18: writing trial11441570-18 from 685719 to 1397658 tid 1 2026-02-20T13:04:31.047 INFO:tasks.rados.rados.0.trial114.stdout:18: writing trial11441570-18 from 1845135 to 2285719 tid 2 2026-02-20T13:04:31.047 INFO:tasks.rados.rados.0.trial114.stdout:19: write initial oid 19 2026-02-20T13:04:31.047 INFO:tasks.rados.rados.0.trial114.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2026-02-20T13:04:31.053 INFO:tasks.rados.rados.0.trial114.stdout:19: writing trial11441570-19 from 702526 to 1489714 tid 1 2026-02-20T13:04:31.056 INFO:tasks.rados.rados.0.trial114.stdout:19: writing trial11441570-19 from 1903617 to 2302526 tid 2 2026-02-20T13:04:31.056 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:04:31.059 INFO:tasks.rados.rados.0.trial114.stdout:18: finishing write tid 1 to trial11441570-18 2026-02-20T13:04:31.078 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:31.079 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:04:31.080 INFO:tasks.rados.rados.0.trial114.stdout:18: finishing write tid 2 to trial11441570-18 2026-02-20T13:04:31.080 INFO:tasks.rados.rados.0.trial114.stdout:18: finishing write tid 3 to trial11441570-18 2026-02-20T13:04:31.082 INFO:tasks.rados.rados.0.trial114.stdout:18: finishing write tid 4 to trial11441570-18 2026-02-20T13:04:31.083 INFO:tasks.rados.rados.0.trial114.stdout:18: oid 18 updating version 0 to 1 2026-02-20T13:04:31.083 INFO:tasks.rados.rados.0.trial114.stdout:18: oid 18 updating version 1 to 3 2026-02-20T13:04:31.083 INFO:tasks.rados.rados.0.trial114.stdout:18: oid 18 version 3 is already newer than 3 2026-02-20T13:04:31.083 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 18 v 3 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-20T13:04:31.083 INFO:tasks.rados.rados.0.trial114.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2026-02-20T13:04:31.084 INFO:tasks.rados.rados.0.trial114.stdout:18: done (15 left) 2026-02-20T13:04:31.084 INFO:tasks.rados.rados.0.trial114.stdout:20: write initial oid 20 2026-02-20T13:04:31.084 INFO:tasks.rados.rados.0.trial114.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2026-02-20T13:04:31.088 INFO:tasks.rados.rados.0.trial114.stdout:20: writing trial11441570-20 from 719333 to 1181770 tid 1 2026-02-20T13:04:31.089 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-20T13:04:30.893788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":3712,"kb_used_data":3712,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208662912,"statfs":{"total":213674622976,"available":213670821888,"internally_reserved":0,"allocated":3801088,"data_stored":3801088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.015492"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.903054+0000","last_change":"2026-02-20T13:04:26.903054+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.903054+0000","last_undegraded":"2026-02-20T13:04:26.903054+0000","last_fullsized":"2026-02-20T13:04:26.903054+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.933648+0000","last_change":"2026-02-20T13:04:26.933648+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.933648+0000","last_undegraded":"2026-02-20T13:04:26.933648+0000","last_fullsized":"2026-02-20T13:04:26.933648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":2,"reported_epoch":17,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.948536+0000","last_change":"2026-02-20T13:04:26.948404+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.948536+0000","last_undegraded":"2026-02-20T13:04:26.948536+0000","last_fullsized":"2026-02-20T13:04:26.948536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":2,"reported_epoch":17,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.938201+0000","last_change":"2026-02-20T13:04:26.938073+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.938201+0000","last_undegraded":"2026-02-20T13:04:26.938201+0000","last_fullsized":"2026-02-20T13:04:26.938201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.922541+0000","last_change":"2026-02-20T13:04:26.922541+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.922541+0000","last_undegraded":"2026-02-20T13:04:26.922541+0000","last_fullsized":"2026-02-20T13:04:26.922541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T13:04:27.933376+0000","last_change":"2026-02-20T13:04:27.933870+0000","last_active":"2026-02-20T13:04:27.933376+0000","last_peered":"2026-02-20T13:04:27.933376+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"2026-02-20T13:04:27.922697+0000","last_became_peered":"2026-02-20T13:04:27.922697+0000","last_unstale":"2026-02-20T13:04:27.933376+0000","last_undegraded":"2026-02-20T13:04:27.933376+0000","last_fullsized":"2026-02-20T13:04:27.933376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T13:04:27.942790+0000","last_change":"2026-02-20T13:04:27.943129+0000","last_active":"2026-02-20T13:04:27.942790+0000","last_peered":"2026-02-20T13:04:27.942790+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"2026-02-20T13:04:27.936053+0000","last_became_peered":"2026-02-20T13:04:27.936053+0000","last_unstale":"2026-02-20T13:04:27.942790+0000","last_undegraded":"2026-02-20T13:04:27.942790+0000","last_fullsized":"2026-02-20T13:04:27.942790+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":2,"reported_epoch":17,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.903341+0000","last_change":"2026-02-20T13:04:26.903122+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.903341+0000","last_undegraded":"2026-02-20T13:04:26.903341+0000","last_fullsized":"2026-02-20T13:04:26.903341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-20T13:04:26.887168+0000","last_change":"2026-02-20T13:04:22.725032+0000","last_active":"2026-02-20T13:04:26.887168+0000","last_peered":"2026-02-20T13:04:26.887168+0000","last_clean":"2026-02-20T13:04:26.887168+0000","last_became_active":"2026-02-20T13:04:20.767651+0000","last_became_peered":"2026-02-20T13:04:20.767651+0000","last_unstale":"2026-02-20T13:04:26.887168+0000","last_undegraded":"2026-02-20T13:04:26.887168+0000","last_fullsized":"2026-02-20T13:04:26.887168+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T13:04:27.922976+0000","last_change":"2026-02-20T13:04:27.923297+0000","last_active":"2026-02-20T13:04:27.922976+0000","last_peered":"2026-02-20T13:04:27.922976+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"2026-02-20T13:04:27.917952+0000","last_became_peered":"2026-02-20T13:04:27.917952+0000","last_unstale":"2026-02-20T13:04:27.922976+0000","last_undegraded":"2026-02-20T13:04:27.922976+0000","last_fullsized":"2026-02-20T13:04:27.922976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T13:04:27.895171+0000","last_change":"2026-02-20T13:04:22.726688+0000","last_active":"2026-02-20T13:04:27.895171+0000","last_peered":"2026-02-20T13:04:27.895171+0000","last_clean":"2026-02-20T13:04:27.895171+0000","last_became_active":"2026-02-20T13:04:20.749427+0000","last_became_peered":"2026-02-20T13:04:20.749427+0000","last_unstale":"2026-02-20T13:04:27.895171+0000","last_undegraded":"2026-02-20T13:04:27.895171+0000","last_fullsized":"2026-02-20T13:04:27.895171+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T13:04:26.873163+0000","last_change":"2026-02-20T13:04:26.873163+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.873163+0000","last_undegraded":"2026-02-20T13:04:26.873163+0000","last_fullsized":"2026-02-20T13:04:26.873163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724655+0000","last_change":"2026-02-20T13:04:22.724655+0000","last_active":"2026-02-20T13:04:22.724655+0000","last_peered":"2026-02-20T13:04:22.724655+0000","last_clean":"2026-02-20T13:04:22.724655+0000","last_became_active":"2026-02-20T13:04:20.752273+0000","last_became_peered":"2026-02-20T13:04:20.752273+0000","last_unstale":"2026-02-20T13:04:22.724655+0000","last_undegraded":"2026-02-20T13:04:22.724655+0000","last_fullsized":"2026-02-20T13:04:22.724655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.891913+0000","last_change":"2026-02-20T13:04:26.891913+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.891913+0000","last_undegraded":"2026-02-20T13:04:26.891913+0000","last_fullsized":"2026-02-20T13:04:26.891913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":20,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-20T13:04:26.888586+0000","last_change":"2026-02-20T13:04:22.725464+0000","last_active":"2026-02-20T13:04:26.888586+0000","last_peered":"2026-02-20T13:04:26.888586+0000","last_clean":"2026-02-20T13:04:26.888586+0000","last_became_active":"2026-02-20T13:04:20.753888+0000","last_became_peered":"2026-02-20T13:04:20.753888+0000","last_unstale":"2026-02-20T13:04:26.888586+0000","last_undegraded":"2026-02-20T13:04:26.888586+0000","last_fullsized":"2026-02-20T13:04:26.888586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":88,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T13:04:27.896266+0000","last_change":"2026-02-20T13:04:20.794473+0000","last_active":"2026-02-20T13:04:27.896266+0000","last_peered":"2026-02-20T13:04:27.896266+0000","last_clean":"2026-02-20T13:04:27.896266+0000","last_became_active":"2026-02-20T13:04:20.784850+0000","last_became_peered":"2026-02-20T13:04:20.784850+0000","last_unstale":"2026-02-20T13:04:27.896266+0000","last_undegraded":"2026-02-20T13:04:27.896266+0000","last_fullsized":"2026-02-20T13:04:27.896266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T13:04:26.873163+0000","last_change":"2026-02-20T13:04:26.873163+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.873163+0000","last_undegraded":"2026-02-20T13:04:26.873163+0000","last_fullsized":"2026-02-20T13:04:26.873163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T13:04:26.873163+0000","last_change":"2026-02-20T13:04:26.873163+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.873163+0000","last_undegraded":"2026-02-20T13:04:26.873163+0000","last_fullsized":"2026-02-20T13:04:26.873163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T13:04:27.895934+0000","last_change":"2026-02-20T13:04:22.726325+0000","last_active":"2026-02-20T13:04:27.895934+0000","last_peered":"2026-02-20T13:04:27.895934+0000","last_clean":"2026-02-20T13:04:27.895934+0000","last_became_active":"2026-02-20T13:04:20.764454+0000","last_became_peered":"2026-02-20T13:04:20.764454+0000","last_unstale":"2026-02-20T13:04:27.895934+0000","last_undegraded":"2026-02-20T13:04:27.895934+0000","last_fullsized":"2026-02-20T13:04:27.895934+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.912630+0000","last_change":"2026-02-20T13:04:26.912630+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.912630+0000","last_undegraded":"2026-02-20T13:04:26.912630+0000","last_fullsized":"2026-02-20T13:04:26.912630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-20T13:04:26.888322+0000","last_change":"2026-02-20T13:04:22.725609+0000","last_active":"2026-02-20T13:04:26.888322+0000","last_peered":"2026-02-20T13:04:26.888322+0000","last_clean":"2026-02-20T13:04:26.888322+0000","last_became_active":"2026-02-20T13:04:20.747942+0000","last_became_peered":"2026-02-20T13:04:20.747942+0000","last_unstale":"2026-02-20T13:04:26.888322+0000","last_undegraded":"2026-02-20T13:04:26.888322+0000","last_fullsized":"2026-02-20T13:04:26.888322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.902260+0000","last_change":"2026-02-20T13:04:26.902260+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.902260+0000","last_undegraded":"2026-02-20T13:04:26.902260+0000","last_fullsized":"2026-02-20T13:04:26.902260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T13:04:27.897635+0000","last_change":"2026-02-20T13:04:22.726258+0000","last_active":"2026-02-20T13:04:27.897635+0000","last_peered":"2026-02-20T13:04:27.897635+0000","last_clean":"2026-02-20T13:04:27.897635+0000","last_became_active":"2026-02-20T13:04:20.753930+0000","last_became_peered":"2026-02-20T13:04:20.753930+0000","last_unstale":"2026-02-20T13:04:27.897635+0000","last_undegraded":"2026-02-20T13:04:27.897635+0000","last_fullsized":"2026-02-20T13:04:27.897635+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":16,"state":"creating+peering","last_fresh":"2026-02-20T13:04:26.892886+0000","last_change":"2026-02-20T13:04:26.892886+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.892886+0000","last_undegraded":"2026-02-20T13:04:26.892886+0000","last_fullsized":"2026-02-20T13:04:26.892886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T13:04:27.895592+0000","last_change":"2026-02-20T13:04:22.726600+0000","last_active":"2026-02-20T13:04:27.895592+0000","last_peered":"2026-02-20T13:04:27.895592+0000","last_clean":"2026-02-20T13:04:27.895592+0000","last_became_active":"2026-02-20T13:04:20.754605+0000","last_became_peered":"2026-02-20T13:04:20.754605+0000","last_unstale":"2026-02-20T13:04:27.895592+0000","last_undegraded":"2026-02-20T13:04:27.895592+0000","last_fullsized":"2026-02-20T13:04:27.895592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160252395520,"internally_reserved":0,"allocated":3571712,"data_stored":3571712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417418752,"internally_reserved":0,"allocated":1236992,"data_stored":1236992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253177856,"internally_reserved":0,"allocated":2789376,"data_stored":2789376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640266,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1208,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165448,"statfs":{"total":53418655744,"available":53417418752,"internally_reserved":0,"allocated":1236992,"data_stored":1236992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1076,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165580,"statfs":{"total":53418655744,"available":53417553920,"internally_reserved":0,"allocated":1101824,"data_stored":1101824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":352,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166304,"statfs":{"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53417463808,"internally_reserved":0,"allocated":1191936,"data_stored":1191936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417418752,"internally_reserved":0,"allocated":1236992,"data_stored":1236992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417418752,"internally_reserved":0,"allocated":1236992,"data_stored":1236992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53418655744,"available":53417463808,"internally_reserved":0,"allocated":1191936,"data_stored":1191936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53418655744,"available":53417512960,"internally_reserved":0,"allocated":1142784,"data_stored":1142784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53418655744,"available":53417418752,"internally_reserved":0,"allocated":1236992,"data_stored":1236992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:04:31.092 INFO:tasks.rados.rados.0.trial114.stdout:20: writing trial11441570-20 from 1962099 to 2319333 tid 2 2026-02-20T13:04:31.092 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:04:31.092 INFO:tasks.rados.rados.0.trial114.stdout:19: finishing write tid 1 to trial11441570-19 2026-02-20T13:04:31.097 INFO:tasks.rados.rados.0.trial114.stdout:19: finishing write tid 2 to trial11441570-19 2026-02-20T13:04:31.099 INFO:tasks.rados.rados.0.trial114.stdout:19: finishing write tid 3 to trial11441570-19 2026-02-20T13:04:31.102 INFO:tasks.rados.rados.0.trial114.stdout:19: finishing write tid 4 to trial11441570-19 2026-02-20T13:04:31.102 INFO:tasks.rados.rados.0.trial114.stdout:19: oid 19 updating version 0 to 10 2026-02-20T13:04:31.102 INFO:tasks.rados.rados.0.trial114.stdout:19: oid 19 updating version 10 to 12 2026-02-20T13:04:31.102 INFO:tasks.rados.rados.0.trial114.stdout:19: oid 19 version 12 is already newer than 12 2026-02-20T13:04:31.102 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 19 v 12 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-20T13:04:31.102 INFO:tasks.rados.rados.0.trial114.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2026-02-20T13:04:31.102 INFO:tasks.rados.rados.0.trial114.stdout:19: done (15 left) 2026-02-20T13:04:31.102 INFO:tasks.rados.rados.0.trial114.stdout:21: write initial oid 21 2026-02-20T13:04:31.102 INFO:tasks.rados.rados.0.trial114.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2026-02-20T13:04:31.106 INFO:tasks.rados.rados.0.trial114.stdout:21: writing trial11441570-21 from 736140 to 1273826 tid 1 2026-02-20T13:04:31.111 INFO:tasks.rados.rados.0.trial114.stdout:21: writing trial11441570-21 from 2020581 to 2336140 tid 2 2026-02-20T13:04:31.111 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:04:36.092 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [1, 2, 3] 2026-02-20T13:04:36.092 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:04:36.093 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [1, 2, 3] 2026-02-20T13:04:36.093 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T13:04:36.093 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:04:36.155 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T13:04:41.156 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0, 1] live_osds: [2, 3] 2026-02-20T13:04:41.156 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:04:41.157 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:04:41.236 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:41.230+0000 7f2af84b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:41.238 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:04:41.235+0000 7f2af84b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:04:41.352 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:04:41.352 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:04:41.360 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2026-02-20T13:04:39.568121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11582000,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":51,"num_write":101,"num_write_kb":6139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":20236,"kb_used_data":20236,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208646388,"statfs":{"total":213674622976,"available":213653901312,"internally_reserved":0,"allocated":20721664,"data_stored":20721664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10991613,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":20,"num_write_kb":5031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.678385"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.901269+0000","last_change":"2026-02-20T13:04:26.903054+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.901269+0000","last_undegraded":"2026-02-20T13:04:29.901269+0000","last_fullsized":"2026-02-20T13:04:29.901269+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.901280+0000","last_change":"2026-02-20T13:04:26.933648+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.901280+0000","last_undegraded":"2026-02-20T13:04:29.901280+0000","last_fullsized":"2026-02-20T13:04:29.901280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.902074+0000","last_change":"2026-02-20T13:04:26.948404+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.902074+0000","last_undegraded":"2026-02-20T13:04:29.902074+0000","last_fullsized":"2026-02-20T13:04:29.902074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.901330+0000","last_change":"2026-02-20T13:04:26.938073+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.901330+0000","last_undegraded":"2026-02-20T13:04:29.901330+0000","last_fullsized":"2026-02-20T13:04:29.901330+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.900479+0000","last_change":"2026-02-20T13:04:26.922541+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.900479+0000","last_undegraded":"2026-02-20T13:04:29.900479+0000","last_fullsized":"2026-02-20T13:04:29.900479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"20'3","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:31.062864+0000","last_change":"2026-02-20T13:04:27.933870+0000","last_active":"2026-02-20T13:04:31.062864+0000","last_peered":"2026-02-20T13:04:31.062864+0000","last_clean":"2026-02-20T13:04:31.062864+0000","last_became_active":"2026-02-20T13:04:27.922697+0000","last_became_peered":"2026-02-20T13:04:27.922697+0000","last_unstale":"2026-02-20T13:04:31.062864+0000","last_undegraded":"2026-02-20T13:04:31.062864+0000","last_fullsized":"2026-02-20T13:04:31.062864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2285719,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"20'12","reported_seq":34,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:31.086823+0000","last_change":"2026-02-20T13:04:27.943129+0000","last_active":"2026-02-20T13:04:31.086823+0000","last_peered":"2026-02-20T13:04:31.086823+0000","last_clean":"2026-02-20T13:04:31.086823+0000","last_became_active":"2026-02-20T13:04:27.936053+0000","last_became_peered":"2026-02-20T13:04:27.936053+0000","last_unstale":"2026-02-20T13:04:31.086823+0000","last_undegraded":"2026-02-20T13:04:31.086823+0000","last_fullsized":"2026-02-20T13:04:31.086823+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8705894,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":16,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.901177+0000","last_change":"2026-02-20T13:04:26.903122+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.901177+0000","last_undegraded":"2026-02-20T13:04:29.901177+0000","last_fullsized":"2026-02-20T13:04:29.901177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:30.906917+0000","last_change":"2026-02-20T13:04:22.725032+0000","last_active":"2026-02-20T13:04:30.906917+0000","last_peered":"2026-02-20T13:04:30.906917+0000","last_clean":"2026-02-20T13:04:30.906917+0000","last_became_active":"2026-02-20T13:04:20.767651+0000","last_became_peered":"2026-02-20T13:04:20.767651+0000","last_unstale":"2026-02-20T13:04:30.906917+0000","last_undegraded":"2026-02-20T13:04:30.906917+0000","last_fullsized":"2026-02-20T13:04:30.906917+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:30.906147+0000","last_change":"2026-02-20T13:04:27.923297+0000","last_active":"2026-02-20T13:04:30.906147+0000","last_peered":"2026-02-20T13:04:30.906147+0000","last_clean":"2026-02-20T13:04:30.906147+0000","last_became_active":"2026-02-20T13:04:27.917952+0000","last_became_peered":"2026-02-20T13:04:27.917952+0000","last_unstale":"2026-02-20T13:04:30.906147+0000","last_undegraded":"2026-02-20T13:04:30.906147+0000","last_fullsized":"2026-02-20T13:04:30.906147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:30.906089+0000","last_change":"2026-02-20T13:04:22.726688+0000","last_active":"2026-02-20T13:04:30.906089+0000","last_peered":"2026-02-20T13:04:30.906089+0000","last_clean":"2026-02-20T13:04:30.906089+0000","last_became_active":"2026-02-20T13:04:20.749427+0000","last_became_peered":"2026-02-20T13:04:20.749427+0000","last_unstale":"2026-02-20T13:04:30.906089+0000","last_undegraded":"2026-02-20T13:04:30.906089+0000","last_fullsized":"2026-02-20T13:04:30.906089+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T13:04:26.873163+0000","last_change":"2026-02-20T13:04:26.873163+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.873163+0000","last_undegraded":"2026-02-20T13:04:26.873163+0000","last_fullsized":"2026-02-20T13:04:26.873163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T13:04:22.724655+0000","last_change":"2026-02-20T13:04:22.724655+0000","last_active":"2026-02-20T13:04:22.724655+0000","last_peered":"2026-02-20T13:04:22.724655+0000","last_clean":"2026-02-20T13:04:22.724655+0000","last_became_active":"2026-02-20T13:04:20.752273+0000","last_became_peered":"2026-02-20T13:04:20.752273+0000","last_unstale":"2026-02-20T13:04:22.724655+0000","last_undegraded":"2026-02-20T13:04:22.724655+0000","last_fullsized":"2026-02-20T13:04:22.724655+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.901361+0000","last_change":"2026-02-20T13:04:26.891913+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.901361+0000","last_undegraded":"2026-02-20T13:04:29.901361+0000","last_fullsized":"2026-02-20T13:04:29.901361+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":32,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:30.908285+0000","last_change":"2026-02-20T13:04:22.725464+0000","last_active":"2026-02-20T13:04:30.908285+0000","last_peered":"2026-02-20T13:04:30.908285+0000","last_clean":"2026-02-20T13:04:30.908285+0000","last_became_active":"2026-02-20T13:04:20.753888+0000","last_became_peered":"2026-02-20T13:04:20.753888+0000","last_unstale":"2026-02-20T13:04:30.908285+0000","last_undegraded":"2026-02-20T13:04:30.908285+0000","last_fullsized":"2026-02-20T13:04:30.908285+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":97,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:30.907356+0000","last_change":"2026-02-20T13:04:20.794473+0000","last_active":"2026-02-20T13:04:30.907356+0000","last_peered":"2026-02-20T13:04:30.907356+0000","last_clean":"2026-02-20T13:04:30.907356+0000","last_became_active":"2026-02-20T13:04:20.784850+0000","last_became_peered":"2026-02-20T13:04:20.784850+0000","last_unstale":"2026-02-20T13:04:30.907356+0000","last_undegraded":"2026-02-20T13:04:30.907356+0000","last_fullsized":"2026-02-20T13:04:30.907356+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T13:04:26.873163+0000","last_change":"2026-02-20T13:04:26.873163+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.873163+0000","last_undegraded":"2026-02-20T13:04:26.873163+0000","last_fullsized":"2026-02-20T13:04:26.873163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T13:04:26.873163+0000","last_change":"2026-02-20T13:04:26.873163+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:26.873163+0000","last_undegraded":"2026-02-20T13:04:26.873163+0000","last_fullsized":"2026-02-20T13:04:26.873163+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:30.906489+0000","last_change":"2026-02-20T13:04:22.726325+0000","last_active":"2026-02-20T13:04:30.906489+0000","last_peered":"2026-02-20T13:04:30.906489+0000","last_clean":"2026-02-20T13:04:30.906489+0000","last_became_active":"2026-02-20T13:04:20.764454+0000","last_became_peered":"2026-02-20T13:04:20.764454+0000","last_unstale":"2026-02-20T13:04:30.906489+0000","last_undegraded":"2026-02-20T13:04:30.906489+0000","last_fullsized":"2026-02-20T13:04:30.906489+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.901019+0000","last_change":"2026-02-20T13:04:26.912630+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.901019+0000","last_undegraded":"2026-02-20T13:04:29.901019+0000","last_fullsized":"2026-02-20T13:04:29.901019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:30.907660+0000","last_change":"2026-02-20T13:04:22.725609+0000","last_active":"2026-02-20T13:04:30.907660+0000","last_peered":"2026-02-20T13:04:30.907660+0000","last_clean":"2026-02-20T13:04:30.907660+0000","last_became_active":"2026-02-20T13:04:20.747942+0000","last_became_peered":"2026-02-20T13:04:20.747942+0000","last_unstale":"2026-02-20T13:04:30.907660+0000","last_undegraded":"2026-02-20T13:04:30.907660+0000","last_fullsized":"2026-02-20T13:04:30.907660+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.900664+0000","last_change":"2026-02-20T13:04:26.902260+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.900664+0000","last_undegraded":"2026-02-20T13:04:29.900664+0000","last_fullsized":"2026-02-20T13:04:29.900664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:30.907181+0000","last_change":"2026-02-20T13:04:22.726258+0000","last_active":"2026-02-20T13:04:30.907181+0000","last_peered":"2026-02-20T13:04:30.907181+0000","last_clean":"2026-02-20T13:04:30.907181+0000","last_became_active":"2026-02-20T13:04:20.753930+0000","last_became_peered":"2026-02-20T13:04:20.753930+0000","last_unstale":"2026-02-20T13:04:30.907181+0000","last_undegraded":"2026-02-20T13:04:30.907181+0000","last_fullsized":"2026-02-20T13:04:30.907181+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":5,"reported_epoch":20,"state":"creating+peering","last_fresh":"2026-02-20T13:04:29.901928+0000","last_change":"2026-02-20T13:04:26.892886+0000","last_active":"2026-02-20T13:04:26.873163+0000","last_peered":"2026-02-20T13:04:26.873163+0000","last_clean":"2026-02-20T13:04:26.873163+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T13:04:29.901928+0000","last_undegraded":"2026-02-20T13:04:29.901928+0000","last_fullsized":"2026-02-20T13:04:29.901928+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":31,"reported_epoch":20,"state":"active+clean","last_fresh":"2026-02-20T13:04:30.905836+0000","last_change":"2026-02-20T13:04:22.726600+0000","last_active":"2026-02-20T13:04:30.905836+0000","last_peered":"2026-02-20T13:04:30.905836+0000","last_clean":"2026-02-20T13:04:30.905836+0000","last_became_active":"2026-02-20T13:04:20.754605+0000","last_became_peered":"2026-02-20T13:04:20.754605+0000","last_unstale":"2026-02-20T13:04:30.905836+0000","last_undegraded":"2026-02-20T13:04:30.905836+0000","last_fullsized":"2026-02-20T13:04:30.905836+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":10991613,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":20,"num_write_kb":5031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160235606016,"internally_reserved":0,"allocated":20361216,"data_stored":20361216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":39,"acting":39,"num_store_stats":3},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53411876864,"internally_reserved":0,"allocated":6778880,"data_stored":6778880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160242012160,"internally_reserved":0,"allocated":13955072,"data_stored":13955072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":6620,"kb_used_data":6620,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52160036,"statfs":{"total":53418655744,"available":53411876864,"internally_reserved":0,"allocated":6778880,"data_stored":6778880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":6608,"kb_used_data":6608,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52160048,"statfs":{"total":53418655744,"available":53411889152,"internally_reserved":0,"allocated":6766592,"data_stored":6766592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":6656,"kb_used_data":6656,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52160000,"statfs":{"total":53418655744,"available":53411840000,"internally_reserved":0,"allocated":6815744,"data_stored":6815744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":352,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166304,"statfs":{"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53418295296,"internally_reserved":0,"allocated":360448,"data_stored":360448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53411840000,"internally_reserved":0,"allocated":6815744,"data_stored":6815744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53411876864,"internally_reserved":0,"allocated":6778880,"data_stored":6778880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53411876864,"internally_reserved":0,"allocated":6778880,"data_stored":6778880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53418655744,"available":53411840000,"internally_reserved":0,"allocated":6815744,"data_stored":6815744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53418655744,"available":53411889152,"internally_reserved":0,"allocated":6766592,"data_stored":6766592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53418655744,"available":53411876864,"internally_reserved":0,"allocated":6778880,"data_stored":6778880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:04:46.363 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0, 1] live_osds: [2, 3] 2026-02-20T13:04:46.363 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:04:46.363 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2026-02-20T13:04:46.363 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T13:04:46.363 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T13:04:46.365 INFO:tasks.ceph.osd.0:Started 2026-02-20T13:04:46.365 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-20T13:04:46.434 INFO:teuthology.orchestra.run.trial114.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:04:46.437 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:04:46.437 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-20T13:04:50.913 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T13:04:51.438 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-20T13:04:51.925 INFO:teuthology.orchestra.run.trial114.stdout:{ 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: "ops_in_flight": [ 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: "type": "peering_event", 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: "id": 5, 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: "detail": { 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: "PeeringEvent": { 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: "from": "?", 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: "pgid": "3.1", 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: "sent": 21, 2026-02-20T13:04:51.926 INFO:teuthology.orchestra.run.trial114.stdout: "requested": 21, 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: "evt": "epoch_sent: 21 epoch_requested: 21 NullEvt +create_info", 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: "events": [ 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "2026-02-20T13:04:49.913789+0000" 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "2026-02-20T13:04:49.913805+0000" 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.927 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2026-02-20T13:04:51.928 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.929 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2026-02-20T13:04:51.930 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.931 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.932 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: ] 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.933 INFO:teuthology.orchestra.run.trial114.stdout: "type": "peering_event", 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "id": 6, 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "detail": { 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "PeeringEvent": { 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "from": "?", 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "pgid": "3.1", 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "sent": 23, 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "requested": 23, 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "evt": "epoch_sent: 23 epoch_requested: 23 NullEvt +create_info", 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "events": [ 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "2026-02-20T13:04:51.912655+0000" 2026-02-20T13:04:51.934 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "2026-02-20T13:04:51.912675+0000", 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: "blocker": { 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: "op_type": "ConnectionPipeline::await_active", 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: "detail": { 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: "waiting": 1, 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: "held_by_operation_id": 5 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.935 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2026-02-20T13:04:51.936 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.937 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.938 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.939 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:04:51.940 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: ] 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout: ] 2026-02-20T13:04:51.941 INFO:teuthology.orchestra.run.trial114.stdout:} 2026-02-20T13:04:54.993 INFO:tasks.rados.rados.0.trial114.stdout:4: finishing write tid 1 to trial11441570-4 2026-02-20T13:04:55.004 INFO:tasks.rados.rados.0.trial114.stdout:4: finishing write tid 2 to trial11441570-4 2026-02-20T13:04:55.008 INFO:tasks.rados.rados.0.trial114.stdout:4: finishing write tid 3 to trial11441570-4 2026-02-20T13:04:55.011 INFO:tasks.rados.rados.0.trial114.stdout:4: finishing write tid 4 to trial11441570-4 2026-02-20T13:04:55.011 INFO:tasks.rados.rados.0.trial114.stdout:4: oid 4 updating version 0 to 1 2026-02-20T13:04:55.011 INFO:tasks.rados.rados.0.trial114.stdout:4: oid 4 updating version 1 to 3 2026-02-20T13:04:55.011 INFO:tasks.rados.rados.0.trial114.stdout:4: oid 4 version 3 is already newer than 3 2026-02-20T13:04:55.011 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-20T13:04:55.011 INFO:tasks.rados.rados.0.trial114.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2026-02-20T13:04:55.011 INFO:tasks.rados.rados.0.trial114.stdout:4: done (15 left) 2026-02-20T13:04:55.011 INFO:tasks.rados.rados.0.trial114.stdout:22: write initial oid 22 2026-02-20T13:04:55.011 INFO:tasks.rados.rados.0.trial114.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2026-02-20T13:04:55.016 INFO:tasks.rados.rados.0.trial114.stdout:22: writing trial11441570-22 from 752947 to 1365882 tid 1 2026-02-20T13:04:55.020 INFO:tasks.rados.rados.0.trial114.stdout:22: writing trial11441570-22 from 1962710 to 2352947 tid 2 2026-02-20T13:04:55.020 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:04:55.020 INFO:tasks.rados.rados.0.trial114.stdout:21: finishing write tid 1 to trial11441570-21 2026-02-20T13:04:55.024 INFO:tasks.rados.rados.0.trial114.stdout:21: finishing write tid 2 to trial11441570-21 2026-02-20T13:04:55.026 INFO:tasks.rados.rados.0.trial114.stdout:21: finishing write tid 3 to trial11441570-21 2026-02-20T13:04:55.027 INFO:tasks.rados.rados.0.trial114.stdout:21: finishing write tid 4 to trial11441570-21 2026-02-20T13:04:55.027 INFO:tasks.rados.rados.0.trial114.stdout:21: oid 21 updating version 0 to 6 2026-02-20T13:04:55.028 INFO:tasks.rados.rados.0.trial114.stdout:21: oid 21 version 6 is already newer than 6 2026-02-20T13:04:55.028 INFO:tasks.rados.rados.0.trial114.stdout:21: oid 21 version 6 is already newer than 4 2026-02-20T13:04:55.028 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 21 v 6 (ObjNum 20 snap 0 seq_num 20) dirty exists 2026-02-20T13:04:55.028 INFO:tasks.rados.rados.0.trial114.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2026-02-20T13:04:55.028 INFO:tasks.rados.rados.0.trial114.stdout:21: done (15 left) 2026-02-20T13:04:55.028 INFO:tasks.rados.rados.0.trial114.stdout:23: write initial oid 23 2026-02-20T13:04:55.028 INFO:tasks.rados.rados.0.trial114.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2026-02-20T13:04:55.033 INFO:tasks.rados.rados.0.trial114.stdout:23: writing trial11441570-23 from 769754 to 1457938 tid 1 2026-02-20T13:04:55.037 INFO:tasks.rados.rados.0.trial114.stdout:23: writing trial11441570-23 from 2021192 to 2369754 tid 2 2026-02-20T13:04:55.037 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:04:56.943 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1] live_osds: [2, 3, 0] 2026-02-20T13:04:56.943 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:04:56.943 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2026-02-20T13:04:56.944 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T13:04:56.944 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T13:04:56.946 INFO:tasks.ceph.osd.1:Started 2026-02-20T13:04:56.947 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-20T13:04:57.016 INFO:teuthology.orchestra.run.trial114.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:04:57.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:04:57.019 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2026-02-20T13:05:02.020 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-20T13:05:02.950 INFO:teuthology.orchestra.run.trial114.stdout:{ 2026-02-20T13:05:02.951 INFO:teuthology.orchestra.run.trial114.stdout: "ops_in_flight": [ 2026-02-20T13:05:02.951 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.951 INFO:teuthology.orchestra.run.trial114.stdout: "type": "peering_event", 2026-02-20T13:05:02.951 INFO:teuthology.orchestra.run.trial114.stdout: "id": 9, 2026-02-20T13:05:02.951 INFO:teuthology.orchestra.run.trial114.stdout: "detail": { 2026-02-20T13:05:02.952 INFO:teuthology.orchestra.run.trial114.stdout: "PeeringEvent": { 2026-02-20T13:05:02.952 INFO:teuthology.orchestra.run.trial114.stdout: "from": "?", 2026-02-20T13:05:02.952 INFO:teuthology.orchestra.run.trial114.stdout: "pgid": "3.0", 2026-02-20T13:05:02.952 INFO:teuthology.orchestra.run.trial114.stdout: "sent": 26, 2026-02-20T13:05:02.952 INFO:teuthology.orchestra.run.trial114.stdout: "requested": 26, 2026-02-20T13:05:02.952 INFO:teuthology.orchestra.run.trial114.stdout: "evt": "epoch_sent: 26 epoch_requested: 26 NullEvt +create_info", 2026-02-20T13:05:02.953 INFO:teuthology.orchestra.run.trial114.stdout: "events": [ 2026-02-20T13:05:02.953 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.953 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2026-02-20T13:05:02.953 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "2026-02-20T13:05:00.938542+0000" 2026-02-20T13:05:02.953 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.953 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.953 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2026-02-20T13:05:02.954 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "2026-02-20T13:05:00.938561+0000" 2026-02-20T13:05:02.954 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.954 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.954 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.954 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.954 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.954 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.954 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2026-02-20T13:05:02.955 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.955 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.955 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.955 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.955 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.955 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.956 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.956 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2026-02-20T13:05:02.956 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.956 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.956 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.956 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.957 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.957 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.957 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.957 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2026-02-20T13:05:02.957 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.957 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.957 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.958 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.958 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.958 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.958 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.958 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2026-02-20T13:05:02.958 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.958 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.959 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.959 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.959 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.959 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.959 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.959 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2026-02-20T13:05:02.960 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.960 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.960 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.960 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.960 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.960 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.960 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.961 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2026-02-20T13:05:02.961 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.961 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.961 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.961 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.961 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.962 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.962 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.962 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2026-02-20T13:05:02.962 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.962 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.962 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.962 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.963 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.963 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.963 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.963 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2026-02-20T13:05:02.963 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.963 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.963 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.963 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.964 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.964 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.964 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.964 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2026-02-20T13:05:02.964 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.964 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:05:02.964 INFO:teuthology.orchestra.run.trial114.stdout: ] 2026-02-20T13:05:02.964 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:05:02.964 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: "type": "peering_event", 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: "id": 10, 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: "detail": { 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: "PeeringEvent": { 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: "from": "?", 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: "pgid": "3.0", 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: "sent": 28, 2026-02-20T13:05:02.965 INFO:teuthology.orchestra.run.trial114.stdout: "requested": 28, 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: "evt": "epoch_sent: 28 epoch_requested: 28 NullEvt +create_info", 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: "events": [ 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::TrackableOperationT::StartEvent", 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "2026-02-20T13:05:02.937111+0000" 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitActive", 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "2026-02-20T13:05:02.937131+0000", 2026-02-20T13:05:02.966 INFO:teuthology.orchestra.run.trial114.stdout: "blocker": { 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: "op_type": "ConnectionPipeline::await_active", 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: "detail": { 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: "waiting": 1, 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: "held_by_operation_id": 9 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.967 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::AwaitMap", 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.968 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)0>::OSDMapBlocker", 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::ConnectionPipeline::GetPGMapping", 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.969 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PerShardPipeline::CreateOrWaitPG", 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.970 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGMap::PGCreationState", 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGPeeringPipeline::AwaitMap", 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.971 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::OSDMapGate<(crimson::osd::OSDMapGateType)1>::OSDMapBlocker", 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::OSDMapBlocker>::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::PGPeeringPipeline::Process", 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::BlockerT::BlockingEvent::ExitBarrierEvent", 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: }, 2026-02-20T13:05:02.972 INFO:teuthology.orchestra.run.trial114.stdout: { 2026-02-20T13:05:02.973 INFO:teuthology.orchestra.run.trial114.stdout: "name": "crimson::osd::TrackableOperationT::CompletionEvent", 2026-02-20T13:05:02.973 INFO:teuthology.orchestra.run.trial114.stdout: "initiated_at": "0.000000" 2026-02-20T13:05:02.973 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:05:02.973 INFO:teuthology.orchestra.run.trial114.stdout: ] 2026-02-20T13:05:02.973 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:05:02.973 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:05:02.973 INFO:teuthology.orchestra.run.trial114.stdout: } 2026-02-20T13:05:02.973 INFO:teuthology.orchestra.run.trial114.stdout: ] 2026-02-20T13:05:02.973 INFO:teuthology.orchestra.run.trial114.stdout:} 2026-02-20T13:05:04.083 INFO:tasks.rados.rados.0.trial114.stdout:16: finishing write tid 1 to trial11441570-16 2026-02-20T13:05:04.085 INFO:tasks.rados.rados.0.trial114.stdout:3: finishing write tid 1 to trial11441570-3 2026-02-20T13:05:04.095 INFO:tasks.rados.rados.0.trial114.stdout:5: finishing write tid 1 to trial11441570-5 2026-02-20T13:05:04.114 INFO:tasks.rados.rados.0.trial114.stdout:3: finishing write tid 2 to trial11441570-3 2026-02-20T13:05:04.117 INFO:tasks.rados.rados.0.trial114.stdout:16: finishing write tid 2 to trial11441570-16 2026-02-20T13:05:04.118 INFO:tasks.rados.rados.0.trial114.stdout:7: finishing write tid 1 to trial11441570-7 2026-02-20T13:05:04.119 INFO:tasks.rados.rados.0.trial114.stdout:3: finishing write tid 3 to trial11441570-3 2026-02-20T13:05:04.120 INFO:tasks.rados.rados.0.trial114.stdout:2: finishing write tid 1 to trial11441570-2 2026-02-20T13:05:04.121 INFO:tasks.rados.rados.0.trial114.stdout:16: finishing write tid 3 to trial11441570-16 2026-02-20T13:05:04.123 INFO:tasks.rados.rados.0.trial114.stdout:10: finishing write tid 1 to trial11441570-10 2026-02-20T13:05:04.125 INFO:tasks.rados.rados.0.trial114.stdout:16: finishing write tid 4 to trial11441570-16 2026-02-20T13:05:04.125 INFO:tasks.rados.rados.0.trial114.stdout:16: oid 16 updating version 0 to 3 2026-02-20T13:05:04.125 INFO:tasks.rados.rados.0.trial114.stdout:16: oid 16 version 3 is already newer than 1 2026-02-20T13:05:04.125 INFO:tasks.rados.rados.0.trial114.stdout:16: oid 16 version 3 is already newer than 3 2026-02-20T13:05:04.125 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 16 v 3 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-20T13:05:04.126 INFO:tasks.rados.rados.0.trial114.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2026-02-20T13:05:04.126 INFO:tasks.rados.rados.0.trial114.stdout:16: done (15 left) 2026-02-20T13:05:04.126 INFO:tasks.rados.rados.0.trial114.stdout:24: write initial oid 24 2026-02-20T13:05:04.126 INFO:tasks.rados.rados.0.trial114.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2026-02-20T13:05:04.130 INFO:tasks.rados.rados.0.trial114.stdout:24: writing trial11441570-24 from 786561 to 1266347 tid 1 2026-02-20T13:05:04.135 INFO:tasks.rados.rados.0.trial114.stdout:24: writing trial11441570-24 from 1796027 to 2263691 tid 2 2026-02-20T13:05:04.135 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.135 INFO:tasks.rados.rados.0.trial114.stdout:5: finishing write tid 2 to trial11441570-5 2026-02-20T13:05:04.135 INFO:tasks.rados.rados.0.trial114.stdout:3: finishing write tid 4 to trial11441570-3 2026-02-20T13:05:04.135 INFO:tasks.rados.rados.0.trial114.stdout:3: oid 3 updating version 0 to 1 2026-02-20T13:05:04.135 INFO:tasks.rados.rados.0.trial114.stdout:3: oid 3 updating version 1 to 3 2026-02-20T13:05:04.135 INFO:tasks.rados.rados.0.trial114.stdout:3: oid 3 version 3 is already newer than 3 2026-02-20T13:05:04.136 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-20T13:05:04.136 INFO:tasks.rados.rados.0.trial114.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2026-02-20T13:05:04.136 INFO:tasks.rados.rados.0.trial114.stdout:5: finishing write tid 3 to trial11441570-5 2026-02-20T13:05:04.136 INFO:tasks.rados.rados.0.trial114.stdout:3: done (15 left) 2026-02-20T13:05:04.136 INFO:tasks.rados.rados.0.trial114.stdout:25: write initial oid 25 2026-02-20T13:05:04.136 INFO:tasks.rados.rados.0.trial114.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2026-02-20T13:05:04.138 INFO:tasks.rados.rados.0.trial114.stdout:25: writing trial11441570-25 from 403368 to 958403 tid 1 2026-02-20T13:05:04.143 INFO:tasks.rados.rados.0.trial114.stdout:25: writing trial11441570-25 from 1454509 to 2182184 tid 2 2026-02-20T13:05:04.143 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.144 INFO:tasks.rados.rados.0.trial114.stdout:5: finishing write tid 4 to trial11441570-5 2026-02-20T13:05:04.144 INFO:tasks.rados.rados.0.trial114.stdout:5: oid 5 updating version 0 to 1 2026-02-20T13:05:04.144 INFO:tasks.rados.rados.0.trial114.stdout:5: oid 5 updating version 1 to 3 2026-02-20T13:05:04.144 INFO:tasks.rados.rados.0.trial114.stdout:5: oid 5 version 3 is already newer than 3 2026-02-20T13:05:04.144 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 5 v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-20T13:05:04.144 INFO:tasks.rados.rados.0.trial114.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2026-02-20T13:05:04.144 INFO:tasks.rados.rados.0.trial114.stdout:5: done (15 left) 2026-02-20T13:05:04.144 INFO:tasks.rados.rados.0.trial114.stdout:26: write initial oid 26 2026-02-20T13:05:04.144 INFO:tasks.rados.rados.0.trial114.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2026-02-20T13:05:04.147 INFO:tasks.rados.rados.0.trial114.stdout:26: writing trial11441570-26 from 420175 to 1050459 tid 1 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:26: writing trial11441570-26 from 1796638 to 2267971 tid 2 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:2: finishing write tid 2 to trial11441570-2 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:7: finishing write tid 2 to trial11441570-7 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:10: finishing write tid 2 to trial11441570-10 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:2: finishing write tid 3 to trial11441570-2 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:7: finishing write tid 3 to trial11441570-7 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:10: finishing write tid 3 to trial11441570-10 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:7: finishing write tid 4 to trial11441570-7 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:7: oid 7 updating version 0 to 1 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:7: oid 7 updating version 1 to 3 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:7: oid 7 version 3 is already newer than 3 2026-02-20T13:05:04.152 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 7 v 3 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-20T13:05:04.153 INFO:tasks.rados.rados.0.trial114.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:05:04.153 INFO:tasks.rados.rados.0.trial114.stdout:7: done (15 left) 2026-02-20T13:05:04.153 INFO:tasks.rados.rados.0.trial114.stdout:27: write initial oid 27 2026-02-20T13:05:04.153 INFO:tasks.rados.rados.0.trial114.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2026-02-20T13:05:04.156 INFO:tasks.rados.rados.0.trial114.stdout:27: writing trial11441570-27 from 436982 to 1142515 tid 1 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:27: writing trial11441570-27 from 1855120 to 2436982 tid 2 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:2: finishing write tid 4 to trial11441570-2 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:2: oid 2 updating version 0 to 1 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:2: oid 2 updating version 1 to 3 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:2: oid 2 version 3 is already newer than 3 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:10: finishing write tid 4 to trial11441570-10 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:10: oid 10 updating version 0 to 4 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:10: oid 10 updating version 4 to 6 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:10: oid 10 version 6 is already newer than 6 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 10 v 6 (ObjNum 9 snap 0 seq_num 9) dirty exists 2026-02-20T13:05:04.162 INFO:tasks.rados.rados.0.trial114.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2026-02-20T13:05:04.163 INFO:tasks.rados.rados.0.trial114.stdout:8: finishing write tid 1 to trial11441570-8 2026-02-20T13:05:04.163 INFO:tasks.rados.rados.0.trial114.stdout:23: finishing write tid 1 to trial11441570-23 2026-02-20T13:05:04.163 INFO:tasks.rados.rados.0.trial114.stdout:2: done (15 left) 2026-02-20T13:05:04.163 INFO:tasks.rados.rados.0.trial114.stdout:10: done (14 left) 2026-02-20T13:05:04.163 INFO:tasks.rados.rados.0.trial114.stdout:28: write initial oid 28 2026-02-20T13:05:04.163 INFO:tasks.rados.rados.0.trial114.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2026-02-20T13:05:04.167 INFO:tasks.rados.rados.0.trial114.stdout:28: writing trial11441570-28 from 453789 to 1234571 tid 1 2026-02-20T13:05:04.171 INFO:tasks.rados.rados.0.trial114.stdout:28: writing trial11441570-28 from 1913602 to 2388604 tid 2 2026-02-20T13:05:04.171 INFO:tasks.rados.rados.0.trial114.stdout:29: write initial oid 29 2026-02-20T13:05:04.171 INFO:tasks.rados.rados.0.trial114.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2026-02-20T13:05:04.175 INFO:tasks.rados.rados.0.trial114.stdout:29: writing trial11441570-29 from 470596 to 926627 tid 1 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout:29: writing trial11441570-29 from 1572084 to 2190744 tid 2 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout:23: finishing write tid 2 to trial11441570-23 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout:8: finishing write tid 2 to trial11441570-8 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout:23: finishing write tid 3 to trial11441570-23 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout:23: finishing write tid 4 to trial11441570-23 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout:23: oid 23 updating version 0 to 4 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout:23: oid 23 updating version 4 to 6 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout:23: oid 23 version 6 is already newer than 6 2026-02-20T13:05:04.181 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2026-02-20T13:05:04.182 INFO:tasks.rados.rados.0.trial114.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2026-02-20T13:05:04.182 INFO:tasks.rados.rados.0.trial114.stdout:24: finishing write tid 1 to trial11441570-24 2026-02-20T13:05:04.182 INFO:tasks.rados.rados.0.trial114.stdout:8: finishing write tid 3 to trial11441570-8 2026-02-20T13:05:04.182 INFO:tasks.rados.rados.0.trial114.stdout:23: done (15 left) 2026-02-20T13:05:04.182 INFO:tasks.rados.rados.0.trial114.stdout:30: write initial oid 30 2026-02-20T13:05:04.182 INFO:tasks.rados.rados.0.trial114.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2026-02-20T13:05:04.184 INFO:tasks.rados.rados.0.trial114.stdout:30: writing trial11441570-30 from 487403 to 1018683 tid 1 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:30: writing trial11441570-30 from 1514213 to 1992884 tid 2 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:8: finishing write tid 4 to trial11441570-8 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:8: oid 8 updating version 0 to 6 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:8: oid 8 version 6 is already newer than 6 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:8: oid 8 version 6 is already newer than 4 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 8 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:8: done (15 left) 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:31: write initial oid 31 2026-02-20T13:05:04.188 INFO:tasks.rados.rados.0.trial114.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2026-02-20T13:05:04.192 INFO:tasks.rados.rados.0.trial114.stdout:31: writing trial11441570-31 from 504210 to 1110739 tid 1 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:31: writing trial11441570-31 from 1572695 to 2195024 tid 2 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:24: finishing write tid 2 to trial11441570-24 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:24: finishing write tid 3 to trial11441570-24 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:24: finishing write tid 4 to trial11441570-24 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:24: oid 24 updating version 0 to 7 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:24: oid 24 updating version 7 to 9 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:24: oid 24 version 9 is already newer than 9 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 24 v 9 (ObjNum 23 snap 0 seq_num 23) dirty exists 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:26: finishing write tid 1 to trial11441570-26 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:24: done (15 left) 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:32: write initial oid 32 2026-02-20T13:05:04.197 INFO:tasks.rados.rados.0.trial114.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2026-02-20T13:05:04.202 INFO:tasks.rados.rados.0.trial114.stdout:32: writing trial11441570-32 from 521017 to 1319148 tid 1 2026-02-20T13:05:04.207 INFO:tasks.rados.rados.0.trial114.stdout:32: writing trial11441570-32 from 1747530 to 2229870 tid 2 2026-02-20T13:05:04.207 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.207 INFO:tasks.rados.rados.0.trial114.stdout:29: finishing write tid 1 to trial11441570-29 2026-02-20T13:05:04.207 INFO:tasks.rados.rados.0.trial114.stdout:27: finishing write tid 1 to trial11441570-27 2026-02-20T13:05:04.207 INFO:tasks.rados.rados.0.trial114.stdout:30: finishing write tid 1 to trial11441570-30 2026-02-20T13:05:04.209 INFO:tasks.rados.rados.0.trial114.stdout:29: finishing write tid 2 to trial11441570-29 2026-02-20T13:05:04.217 INFO:tasks.rados.rados.0.trial114.stdout:30: finishing write tid 2 to trial11441570-30 2026-02-20T13:05:04.218 INFO:tasks.rados.rados.0.trial114.stdout:26: finishing write tid 2 to trial11441570-26 2026-02-20T13:05:04.220 INFO:tasks.rados.rados.0.trial114.stdout:30: finishing write tid 3 to trial11441570-30 2026-02-20T13:05:04.222 INFO:tasks.rados.rados.0.trial114.stdout:30: finishing write tid 4 to trial11441570-30 2026-02-20T13:05:04.222 INFO:tasks.rados.rados.0.trial114.stdout:30: oid 30 updating version 0 to 10 2026-02-20T13:05:04.222 INFO:tasks.rados.rados.0.trial114.stdout:30: oid 30 updating version 10 to 12 2026-02-20T13:05:04.222 INFO:tasks.rados.rados.0.trial114.stdout:30: oid 30 version 12 is already newer than 12 2026-02-20T13:05:04.222 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 30 v 12 (ObjNum 29 snap 0 seq_num 29) dirty exists 2026-02-20T13:05:04.222 INFO:tasks.rados.rados.0.trial114.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2026-02-20T13:05:04.222 INFO:tasks.rados.rados.0.trial114.stdout:30: done (15 left) 2026-02-20T13:05:04.222 INFO:tasks.rados.rados.0.trial114.stdout:33: write initial oid 33 2026-02-20T13:05:04.222 INFO:tasks.rados.rados.0.trial114.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2026-02-20T13:05:04.226 INFO:tasks.rados.rados.0.trial114.stdout:33: writing trial11441570-33 from 537824 to 1011204 tid 1 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:33: writing trial11441570-33 from 1806012 to 2432010 tid 2 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:29: finishing write tid 3 to trial11441570-29 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:29: finishing write tid 4 to trial11441570-29 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:29: oid 29 updating version 0 to 13 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:29: oid 29 updating version 13 to 15 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:29: oid 29 version 15 is already newer than 15 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 29 v 15 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:26: finishing write tid 3 to trial11441570-26 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:26: finishing write tid 4 to trial11441570-26 2026-02-20T13:05:04.232 INFO:tasks.rados.rados.0.trial114.stdout:26: oid 26 updating version 0 to 4 2026-02-20T13:05:04.233 INFO:tasks.rados.rados.0.trial114.stdout:26: oid 26 updating version 4 to 6 2026-02-20T13:05:04.233 INFO:tasks.rados.rados.0.trial114.stdout:26: oid 26 version 6 is already newer than 6 2026-02-20T13:05:04.233 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 26 v 6 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-20T13:05:04.233 INFO:tasks.rados.rados.0.trial114.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2026-02-20T13:05:04.233 INFO:tasks.rados.rados.0.trial114.stdout:27: finishing write tid 2 to trial11441570-27 2026-02-20T13:05:04.233 INFO:tasks.rados.rados.0.trial114.stdout:26: done (15 left) 2026-02-20T13:05:04.233 INFO:tasks.rados.rados.0.trial114.stdout:29: done (14 left) 2026-02-20T13:05:04.233 INFO:tasks.rados.rados.0.trial114.stdout:34: write initial oid 34 2026-02-20T13:05:04.233 INFO:tasks.rados.rados.0.trial114.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2026-02-20T13:05:04.236 INFO:tasks.rados.rados.0.trial114.stdout:34: writing trial11441570-34 from 554631 to 1103260 tid 1 2026-02-20T13:05:04.240 INFO:tasks.rados.rados.0.trial114.stdout:34: writing trial11441570-34 from 1748141 to 2234150 tid 2 2026-02-20T13:05:04.240 INFO:tasks.rados.rados.0.trial114.stdout:35: write initial oid 35 2026-02-20T13:05:04.241 INFO:tasks.rados.rados.0.trial114.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2026-02-20T13:05:04.245 INFO:tasks.rados.rados.0.trial114.stdout:35: writing trial11441570-35 from 571438 to 1195316 tid 1 2026-02-20T13:05:04.250 INFO:tasks.rados.rados.0.trial114.stdout:35: writing trial11441570-35 from 1806623 to 2436290 tid 2 2026-02-20T13:05:04.250 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.250 INFO:tasks.rados.rados.0.trial114.stdout:27: finishing write tid 3 to trial11441570-27 2026-02-20T13:05:04.250 INFO:tasks.rados.rados.0.trial114.stdout:27: finishing write tid 4 to trial11441570-27 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:27: oid 27 updating version 0 to 3 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:27: oid 27 version 3 is already newer than 3 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:27: oid 27 version 3 is already newer than 1 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 27 v 3 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:33: finishing write tid 1 to trial11441570-33 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:32: finishing write tid 1 to trial11441570-32 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:27: done (15 left) 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:36: write initial oid 36 2026-02-20T13:05:04.251 INFO:tasks.rados.rados.0.trial114.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2026-02-20T13:05:04.255 INFO:tasks.rados.rados.0.trial114.stdout:36: writing trial11441570-36 from 588245 to 1287372 tid 1 2026-02-20T13:05:04.259 INFO:tasks.rados.rados.0.trial114.stdout:36: writing trial11441570-36 from 1865105 to 2354783 tid 2 2026-02-20T13:05:04.259 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.260 INFO:tasks.rados.rados.0.trial114.stdout:31: finishing write tid 1 to trial11441570-31 2026-02-20T13:05:04.263 INFO:tasks.rados.rados.0.trial114.stdout:33: finishing write tid 2 to trial11441570-33 2026-02-20T13:05:04.269 INFO:tasks.rados.rados.0.trial114.stdout:28: finishing write tid 1 to trial11441570-28 2026-02-20T13:05:04.270 INFO:tasks.rados.rados.0.trial114.stdout:31: finishing write tid 2 to trial11441570-31 2026-02-20T13:05:04.276 INFO:tasks.rados.rados.0.trial114.stdout:32: finishing write tid 2 to trial11441570-32 2026-02-20T13:05:04.277 INFO:tasks.rados.rados.0.trial114.stdout:31: finishing write tid 3 to trial11441570-31 2026-02-20T13:05:04.280 INFO:tasks.rados.rados.0.trial114.stdout:31: finishing write tid 4 to trial11441570-31 2026-02-20T13:05:04.280 INFO:tasks.rados.rados.0.trial114.stdout:31: oid 31 updating version 0 to 7 2026-02-20T13:05:04.280 INFO:tasks.rados.rados.0.trial114.stdout:31: oid 31 updating version 7 to 9 2026-02-20T13:05:04.280 INFO:tasks.rados.rados.0.trial114.stdout:31: oid 31 version 9 is already newer than 9 2026-02-20T13:05:04.280 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 31 v 9 (ObjNum 30 snap 0 seq_num 30) dirty exists 2026-02-20T13:05:04.281 INFO:tasks.rados.rados.0.trial114.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2026-02-20T13:05:04.281 INFO:tasks.rados.rados.0.trial114.stdout:31: done (15 left) 2026-02-20T13:05:04.281 INFO:tasks.rados.rados.0.trial114.stdout:37: write initial oid 37 2026-02-20T13:05:04.281 INFO:tasks.rados.rados.0.trial114.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2026-02-20T13:05:04.285 INFO:tasks.rados.rados.0.trial114.stdout:37: writing trial11441570-37 from 605052 to 1379428 tid 1 2026-02-20T13:05:04.290 INFO:tasks.rados.rados.0.trial114.stdout:37: writing trial11441570-37 from 1923587 to 2556923 tid 2 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:33: finishing write tid 3 to trial11441570-33 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:33: finishing write tid 4 to trial11441570-33 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:33: oid 33 updating version 0 to 3 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:33: oid 33 version 3 is already newer than 1 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:33: oid 33 version 3 is already newer than 3 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 33 v 3 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:32: finishing write tid 3 to trial11441570-32 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:33: done (15 left) 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:38: write initial oid 38 2026-02-20T13:05:04.291 INFO:tasks.rados.rados.0.trial114.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2026-02-20T13:05:04.294 INFO:tasks.rados.rados.0.trial114.stdout:38: writing trial11441570-38 from 621859 to 1071484 tid 1 2026-02-20T13:05:04.300 INFO:tasks.rados.rados.0.trial114.stdout:38: writing trial11441570-38 from 1865716 to 2621859 tid 2 2026-02-20T13:05:04.300 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.300 INFO:tasks.rados.rados.0.trial114.stdout:34: finishing write tid 1 to trial11441570-34 2026-02-20T13:05:04.300 INFO:tasks.rados.rados.0.trial114.stdout:32: finishing write tid 4 to trial11441570-32 2026-02-20T13:05:04.301 INFO:tasks.rados.rados.0.trial114.stdout:32: oid 32 updating version 0 to 6 2026-02-20T13:05:04.301 INFO:tasks.rados.rados.0.trial114.stdout:32: oid 32 version 6 is already newer than 6 2026-02-20T13:05:04.301 INFO:tasks.rados.rados.0.trial114.stdout:32: oid 32 version 6 is already newer than 4 2026-02-20T13:05:04.301 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 32 v 6 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-20T13:05:04.301 INFO:tasks.rados.rados.0.trial114.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2026-02-20T13:05:04.301 INFO:tasks.rados.rados.0.trial114.stdout:32: done (15 left) 2026-02-20T13:05:04.301 INFO:tasks.rados.rados.0.trial114.stdout:39: write initial oid 39 2026-02-20T13:05:04.301 INFO:tasks.rados.rados.0.trial114.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2026-02-20T13:05:04.304 INFO:tasks.rados.rados.0.trial114.stdout:39: writing trial11441570-39 from 638666 to 1163540 tid 1 2026-02-20T13:05:04.310 INFO:tasks.rados.rados.0.trial114.stdout:39: writing trial11441570-39 from 1924198 to 2561203 tid 2 2026-02-20T13:05:04.310 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.310 INFO:tasks.rados.rados.0.trial114.stdout:34: finishing write tid 2 to trial11441570-34 2026-02-20T13:05:04.310 INFO:tasks.rados.rados.0.trial114.stdout:28: finishing write tid 2 to trial11441570-28 2026-02-20T13:05:04.312 INFO:tasks.rados.rados.0.trial114.stdout:34: finishing write tid 3 to trial11441570-34 2026-02-20T13:05:04.315 INFO:tasks.rados.rados.0.trial114.stdout:34: finishing write tid 4 to trial11441570-34 2026-02-20T13:05:04.315 INFO:tasks.rados.rados.0.trial114.stdout:34: oid 34 updating version 0 to 12 2026-02-20T13:05:04.316 INFO:tasks.rados.rados.0.trial114.stdout:34: oid 34 version 12 is already newer than 12 2026-02-20T13:05:04.316 INFO:tasks.rados.rados.0.trial114.stdout:34: oid 34 version 12 is already newer than 10 2026-02-20T13:05:04.316 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 34 v 12 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-20T13:05:04.316 INFO:tasks.rados.rados.0.trial114.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2026-02-20T13:05:04.316 INFO:tasks.rados.rados.0.trial114.stdout:34: done (15 left) 2026-02-20T13:05:04.316 INFO:tasks.rados.rados.0.trial114.stdout:40: write initial oid 40 2026-02-20T13:05:04.316 INFO:tasks.rados.rados.0.trial114.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2026-02-20T13:05:04.321 INFO:tasks.rados.rados.0.trial114.stdout:40: writing trial11441570-40 from 655473 to 1371949 tid 1 2026-02-20T13:05:04.326 INFO:tasks.rados.rados.0.trial114.stdout:40: writing trial11441570-40 from 2099033 to 2655473 tid 2 2026-02-20T13:05:04.326 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:28: finishing write tid 3 to trial11441570-28 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:28: finishing write tid 4 to trial11441570-28 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:28: oid 28 updating version 0 to 6 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:28: oid 28 version 6 is already newer than 4 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:28: oid 28 version 6 is already newer than 6 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 28 v 6 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:39: finishing write tid 1 to trial11441570-39 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:28: done (15 left) 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:41: write initial oid 41 2026-02-20T13:05:04.327 INFO:tasks.rados.rados.0.trial114.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2026-02-20T13:05:04.332 INFO:tasks.rados.rados.0.trial114.stdout:41: writing trial11441570-41 from 672280 to 1464005 tid 1 2026-02-20T13:05:04.337 INFO:tasks.rados.rados.0.trial114.stdout:41: writing trial11441570-41 from 2157515 to 2672280 tid 2 2026-02-20T13:05:04.337 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.337 INFO:tasks.rados.rados.0.trial114.stdout:38: finishing write tid 1 to trial11441570-38 2026-02-20T13:05:04.337 INFO:tasks.rados.rados.0.trial114.stdout:39: finishing write tid 2 to trial11441570-39 2026-02-20T13:05:04.340 INFO:tasks.rados.rados.0.trial114.stdout:35: finishing write tid 1 to trial11441570-35 2026-02-20T13:05:04.341 INFO:tasks.rados.rados.0.trial114.stdout:39: finishing write tid 3 to trial11441570-39 2026-02-20T13:05:04.343 INFO:tasks.rados.rados.0.trial114.stdout:39: finishing write tid 4 to trial11441570-39 2026-02-20T13:05:04.343 INFO:tasks.rados.rados.0.trial114.stdout:39: oid 39 updating version 0 to 15 2026-02-20T13:05:04.343 INFO:tasks.rados.rados.0.trial114.stdout:39: oid 39 version 15 is already newer than 13 2026-02-20T13:05:04.343 INFO:tasks.rados.rados.0.trial114.stdout:39: oid 39 version 15 is already newer than 15 2026-02-20T13:05:04.344 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 39 v 15 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-20T13:05:04.344 INFO:tasks.rados.rados.0.trial114.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2026-02-20T13:05:04.344 INFO:tasks.rados.rados.0.trial114.stdout:39: done (15 left) 2026-02-20T13:05:04.344 INFO:tasks.rados.rados.0.trial114.stdout:42: write initial oid 42 2026-02-20T13:05:04.344 INFO:tasks.rados.rados.0.trial114.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2026-02-20T13:05:04.347 INFO:tasks.rados.rados.0.trial114.stdout:42: writing trial11441570-42 from 689087 to 1156061 tid 1 2026-02-20T13:05:04.353 INFO:tasks.rados.rados.0.trial114.stdout:42: writing trial11441570-42 from 1699644 to 2483976 tid 2 2026-02-20T13:05:04.353 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.361 INFO:tasks.rados.rados.0.trial114.stdout:35: finishing write tid 2 to trial11441570-35 2026-02-20T13:05:04.367 INFO:tasks.rados.rados.0.trial114.stdout:42: finishing write tid 1 to trial11441570-42 2026-02-20T13:05:04.376 INFO:tasks.rados.rados.0.trial114.stdout:38: finishing write tid 2 to trial11441570-38 2026-02-20T13:05:04.379 INFO:tasks.rados.rados.0.trial114.stdout:42: finishing write tid 2 to trial11441570-42 2026-02-20T13:05:04.382 INFO:tasks.rados.rados.0.trial114.stdout:38: finishing write tid 3 to trial11441570-38 2026-02-20T13:05:04.382 INFO:tasks.rados.rados.0.trial114.stdout:42: finishing write tid 3 to trial11441570-42 2026-02-20T13:05:04.384 INFO:tasks.rados.rados.0.trial114.stdout:42: finishing write tid 4 to trial11441570-42 2026-02-20T13:05:04.384 INFO:tasks.rados.rados.0.trial114.stdout:42: oid 42 updating version 0 to 4 2026-02-20T13:05:04.384 INFO:tasks.rados.rados.0.trial114.stdout:42: oid 42 updating version 4 to 6 2026-02-20T13:05:04.384 INFO:tasks.rados.rados.0.trial114.stdout:42: oid 42 version 6 is already newer than 6 2026-02-20T13:05:04.384 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 42 v 6 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-20T13:05:04.384 INFO:tasks.rados.rados.0.trial114.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2026-02-20T13:05:04.384 INFO:tasks.rados.rados.0.trial114.stdout:42: done (15 left) 2026-02-20T13:05:04.384 INFO:tasks.rados.rados.0.trial114.stdout:43: write initial oid 43 2026-02-20T13:05:04.384 INFO:tasks.rados.rados.0.trial114.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2026-02-20T13:05:04.388 INFO:tasks.rados.rados.0.trial114.stdout:43: writing trial11441570-43 from 705894 to 1248117 tid 1 2026-02-20T13:05:04.393 INFO:tasks.rados.rados.0.trial114.stdout:43: writing trial11441570-43 from 1758126 to 2402469 tid 2 2026-02-20T13:05:04.393 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.393 INFO:tasks.rados.rados.0.trial114.stdout:38: finishing write tid 4 to trial11441570-38 2026-02-20T13:05:04.393 INFO:tasks.rados.rados.0.trial114.stdout:38: oid 38 updating version 0 to 9 2026-02-20T13:05:04.393 INFO:tasks.rados.rados.0.trial114.stdout:38: oid 38 version 9 is already newer than 9 2026-02-20T13:05:04.393 INFO:tasks.rados.rados.0.trial114.stdout:38: oid 38 version 9 is already newer than 7 2026-02-20T13:05:04.393 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 38 v 9 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-20T13:05:04.393 INFO:tasks.rados.rados.0.trial114.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2026-02-20T13:05:04.393 INFO:tasks.rados.rados.0.trial114.stdout:35: finishing write tid 3 to trial11441570-35 2026-02-20T13:05:04.394 INFO:tasks.rados.rados.0.trial114.stdout:38: done (15 left) 2026-02-20T13:05:04.394 INFO:tasks.rados.rados.0.trial114.stdout:44: write initial oid 44 2026-02-20T13:05:04.394 INFO:tasks.rados.rados.0.trial114.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2026-02-20T13:05:04.398 INFO:tasks.rados.rados.0.trial114.stdout:44: writing trial11441570-44 from 722701 to 1340173 tid 1 2026-02-20T13:05:04.403 INFO:tasks.rados.rados.0.trial114.stdout:44: writing trial11441570-44 from 1816608 to 2604609 tid 2 2026-02-20T13:05:04.403 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.403 INFO:tasks.rados.rados.0.trial114.stdout:35: finishing write tid 4 to trial11441570-35 2026-02-20T13:05:04.404 INFO:tasks.rados.rados.0.trial114.stdout:35: oid 35 updating version 0 to 7 2026-02-20T13:05:04.404 INFO:tasks.rados.rados.0.trial114.stdout:35: oid 35 updating version 7 to 9 2026-02-20T13:05:04.404 INFO:tasks.rados.rados.0.trial114.stdout:35: oid 35 version 9 is already newer than 9 2026-02-20T13:05:04.404 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 35 v 9 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-20T13:05:04.404 INFO:tasks.rados.rados.0.trial114.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2026-02-20T13:05:04.404 INFO:tasks.rados.rados.0.trial114.stdout:35: done (15 left) 2026-02-20T13:05:04.404 INFO:tasks.rados.rados.0.trial114.stdout:45: write initial oid 45 2026-02-20T13:05:04.404 INFO:tasks.rados.rados.0.trial114.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2026-02-20T13:05:04.409 INFO:tasks.rados.rados.0.trial114.stdout:45: writing trial11441570-45 from 739508 to 1432229 tid 1 2026-02-20T13:05:04.413 INFO:tasks.rados.rados.0.trial114.stdout:45: writing trial11441570-45 from 1875090 to 2523102 tid 2 2026-02-20T13:05:04.413 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.413 INFO:tasks.rados.rados.0.trial114.stdout:36: finishing write tid 1 to trial11441570-36 2026-02-20T13:05:04.422 INFO:tasks.rados.rados.0.trial114.stdout:40: finishing write tid 1 to trial11441570-40 2026-02-20T13:05:04.429 INFO:tasks.rados.rados.0.trial114.stdout:36: finishing write tid 2 to trial11441570-36 2026-02-20T13:05:04.431 INFO:tasks.rados.rados.0.trial114.stdout:45: finishing write tid 1 to trial11441570-45 2026-02-20T13:05:04.444 INFO:tasks.rados.rados.0.trial114.stdout:40: finishing write tid 2 to trial11441570-40 2026-02-20T13:05:04.445 INFO:tasks.rados.rados.0.trial114.stdout:45: finishing write tid 2 to trial11441570-45 2026-02-20T13:05:04.448 INFO:tasks.rados.rados.0.trial114.stdout:45: finishing write tid 3 to trial11441570-45 2026-02-20T13:05:04.450 INFO:tasks.rados.rados.0.trial114.stdout:45: finishing write tid 4 to trial11441570-45 2026-02-20T13:05:04.450 INFO:tasks.rados.rados.0.trial114.stdout:45: oid 45 updating version 0 to 16 2026-02-20T13:05:04.450 INFO:tasks.rados.rados.0.trial114.stdout:45: oid 45 updating version 16 to 18 2026-02-20T13:05:04.450 INFO:tasks.rados.rados.0.trial114.stdout:45: oid 45 version 18 is already newer than 18 2026-02-20T13:05:04.450 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 45 v 18 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-20T13:05:04.451 INFO:tasks.rados.rados.0.trial114.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2026-02-20T13:05:04.451 INFO:tasks.rados.rados.0.trial114.stdout:45: done (15 left) 2026-02-20T13:05:04.451 INFO:tasks.rados.rados.0.trial114.stdout:46: write initial oid 46 2026-02-20T13:05:04.451 INFO:tasks.rados.rados.0.trial114.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2026-02-20T13:05:04.456 INFO:tasks.rados.rados.0.trial114.stdout:46: writing trial11441570-46 from 756315 to 1524285 tid 1 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout:46: writing trial11441570-46 from 1933572 to 2725242 tid 2 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout:40: finishing write tid 3 to trial11441570-40 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout:40: finishing write tid 4 to trial11441570-40 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout:40: oid 40 updating version 0 to 10 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout:40: oid 40 updating version 10 to 12 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout:40: oid 40 version 12 is already newer than 12 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 40 v 12 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2026-02-20T13:05:04.461 INFO:tasks.rados.rados.0.trial114.stdout:40: done (15 left) 2026-02-20T13:05:04.462 INFO:tasks.rados.rados.0.trial114.stdout:47: write initial oid 47 2026-02-20T13:05:04.462 INFO:tasks.rados.rados.0.trial114.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2026-02-20T13:05:04.465 INFO:tasks.rados.rados.0.trial114.stdout:47: writing trial11441570-47 from 773122 to 1332694 tid 1 2026-02-20T13:05:04.471 INFO:tasks.rados.rados.0.trial114.stdout:47: writing trial11441570-47 from 1992054 to 2643735 tid 2 2026-02-20T13:05:04.471 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.471 INFO:tasks.rados.rados.0.trial114.stdout:36: finishing write tid 3 to trial11441570-36 2026-02-20T13:05:04.471 INFO:tasks.rados.rados.0.trial114.stdout:36: finishing write tid 4 to trial11441570-36 2026-02-20T13:05:04.471 INFO:tasks.rados.rados.0.trial114.stdout:36: oid 36 updating version 0 to 10 2026-02-20T13:05:04.471 INFO:tasks.rados.rados.0.trial114.stdout:36: oid 36 updating version 10 to 12 2026-02-20T13:05:04.471 INFO:tasks.rados.rados.0.trial114.stdout:36: oid 36 version 12 is already newer than 12 2026-02-20T13:05:04.471 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 36 v 12 (ObjNum 35 snap 0 seq_num 35) dirty exists 2026-02-20T13:05:04.471 INFO:tasks.rados.rados.0.trial114.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2026-02-20T13:05:04.472 INFO:tasks.rados.rados.0.trial114.stdout:37: finishing write tid 1 to trial11441570-37 2026-02-20T13:05:04.472 INFO:tasks.rados.rados.0.trial114.stdout:36: done (15 left) 2026-02-20T13:05:04.472 INFO:tasks.rados.rados.0.trial114.stdout:48: write initial oid 48 2026-02-20T13:05:04.472 INFO:tasks.rados.rados.0.trial114.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2026-02-20T13:05:04.476 INFO:tasks.rados.rados.0.trial114.stdout:48: writing trial11441570-48 from 789929 to 1424750 tid 1 2026-02-20T13:05:04.482 INFO:tasks.rados.rados.0.trial114.stdout:48: writing trial11441570-48 from 2050536 to 2789929 tid 2 2026-02-20T13:05:04.482 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.489 INFO:tasks.rados.rados.0.trial114.stdout:41: finishing write tid 1 to trial11441570-41 2026-02-20T13:05:04.498 INFO:tasks.rados.rados.0.trial114.stdout:48: finishing write tid 1 to trial11441570-48 2026-02-20T13:05:04.499 INFO:tasks.rados.rados.0.trial114.stdout:37: finishing write tid 2 to trial11441570-37 2026-02-20T13:05:04.511 INFO:tasks.rados.rados.0.trial114.stdout:37: finishing write tid 3 to trial11441570-37 2026-02-20T13:05:04.516 INFO:tasks.rados.rados.0.trial114.stdout:37: finishing write tid 4 to trial11441570-37 2026-02-20T13:05:04.516 INFO:tasks.rados.rados.0.trial114.stdout:37: oid 37 updating version 0 to 13 2026-02-20T13:05:04.516 INFO:tasks.rados.rados.0.trial114.stdout:37: oid 37 updating version 13 to 15 2026-02-20T13:05:04.516 INFO:tasks.rados.rados.0.trial114.stdout:37: oid 37 version 15 is already newer than 15 2026-02-20T13:05:04.516 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 37 v 15 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-20T13:05:04.516 INFO:tasks.rados.rados.0.trial114.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2026-02-20T13:05:04.516 INFO:tasks.rados.rados.0.trial114.stdout:37: done (15 left) 2026-02-20T13:05:04.516 INFO:tasks.rados.rados.0.trial114.stdout:49: write initial oid 49 2026-02-20T13:05:04.516 INFO:tasks.rados.rados.0.trial114.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2026-02-20T13:05:04.520 INFO:tasks.rados.rados.0.trial114.stdout:49: writing trial11441570-49 from 406736 to 1116806 tid 1 2026-02-20T13:05:04.526 INFO:tasks.rados.rados.0.trial114.stdout:49: writing trial11441570-49 from 1709018 to 2364368 tid 2 2026-02-20T13:05:04.526 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.527 INFO:tasks.rados.rados.0.trial114.stdout:41: finishing write tid 2 to trial11441570-41 2026-02-20T13:05:04.527 INFO:tasks.rados.rados.0.trial114.stdout:48: finishing write tid 2 to trial11441570-48 2026-02-20T13:05:04.533 INFO:tasks.rados.rados.0.trial114.stdout:41: finishing write tid 3 to trial11441570-41 2026-02-20T13:05:04.533 INFO:tasks.rados.rados.0.trial114.stdout:48: finishing write tid 3 to trial11441570-48 2026-02-20T13:05:04.536 INFO:tasks.rados.rados.0.trial114.stdout:48: finishing write tid 4 to trial11441570-48 2026-02-20T13:05:04.536 INFO:tasks.rados.rados.0.trial114.stdout:48: oid 48 updating version 0 to 9 2026-02-20T13:05:04.536 INFO:tasks.rados.rados.0.trial114.stdout:48: oid 48 version 9 is already newer than 7 2026-02-20T13:05:04.536 INFO:tasks.rados.rados.0.trial114.stdout:48: oid 48 version 9 is already newer than 9 2026-02-20T13:05:04.536 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 48 v 9 (ObjNum 47 snap 0 seq_num 47) dirty exists 2026-02-20T13:05:04.536 INFO:tasks.rados.rados.0.trial114.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2026-02-20T13:05:04.536 INFO:tasks.rados.rados.0.trial114.stdout:48: done (15 left) 2026-02-20T13:05:04.536 INFO:tasks.rados.rados.0.trial114.stdout:50: write initial oid 50 2026-02-20T13:05:04.537 INFO:tasks.rados.rados.0.trial114.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2026-02-20T13:05:04.540 INFO:tasks.rados.rados.0.trial114.stdout:50: writing trial11441570-50 from 423543 to 1208862 tid 1 2026-02-20T13:05:04.547 INFO:tasks.rados.rados.0.trial114.stdout:50: writing trial11441570-50 from 1767500 to 2566508 tid 2 2026-02-20T13:05:04.547 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.547 INFO:tasks.rados.rados.0.trial114.stdout:41: finishing write tid 4 to trial11441570-41 2026-02-20T13:05:04.547 INFO:tasks.rados.rados.0.trial114.stdout:41: oid 41 updating version 0 to 15 2026-02-20T13:05:04.547 INFO:tasks.rados.rados.0.trial114.stdout:41: oid 41 version 15 is already newer than 13 2026-02-20T13:05:04.547 INFO:tasks.rados.rados.0.trial114.stdout:41: oid 41 version 15 is already newer than 15 2026-02-20T13:05:04.548 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 41 v 15 (ObjNum 40 snap 0 seq_num 40) dirty exists 2026-02-20T13:05:04.548 INFO:tasks.rados.rados.0.trial114.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2026-02-20T13:05:04.548 INFO:tasks.rados.rados.0.trial114.stdout:49: finishing write tid 1 to trial11441570-49 2026-02-20T13:05:04.548 INFO:tasks.rados.rados.0.trial114.stdout:41: done (15 left) 2026-02-20T13:05:04.548 INFO:tasks.rados.rados.0.trial114.stdout:51: write (excl) oid 28 current snap is 0 2026-02-20T13:05:04.548 INFO:tasks.rados.rados.0.trial114.stdout:51: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2026-02-20T13:05:04.550 INFO:tasks.rados.rados.0.trial114.stdout:51: writing trial11441570-28 from 440350 to 900918 tid 1 2026-02-20T13:05:04.554 INFO:tasks.rados.rados.0.trial114.stdout:51: writing trial11441570-28 from 1309629 to 1852295 tid 2 2026-02-20T13:05:04.558 INFO:tasks.rados.rados.0.trial114.stdout:51: writing trial11441570-28 from 2323973 to 2840350 tid 3 2026-02-20T13:05:04.558 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.559 INFO:tasks.rados.rados.0.trial114.stdout:46: finishing write tid 1 to trial11441570-46 2026-02-20T13:05:04.559 INFO:tasks.rados.rados.0.trial114.stdout:49: finishing write tid 2 to trial11441570-49 2026-02-20T13:05:04.560 INFO:tasks.rados.rados.0.trial114.stdout:43: finishing write tid 1 to trial11441570-43 2026-02-20T13:05:04.561 INFO:tasks.rados.rados.0.trial114.stdout:49: finishing write tid 3 to trial11441570-49 2026-02-20T13:05:04.564 INFO:tasks.rados.rados.0.trial114.stdout:49: finishing write tid 4 to trial11441570-49 2026-02-20T13:05:04.565 INFO:tasks.rados.rados.0.trial114.stdout:49: oid 49 updating version 0 to 3 2026-02-20T13:05:04.565 INFO:tasks.rados.rados.0.trial114.stdout:49: oid 49 version 3 is already newer than 1 2026-02-20T13:05:04.565 INFO:tasks.rados.rados.0.trial114.stdout:49: oid 49 version 3 is already newer than 3 2026-02-20T13:05:04.565 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 49 v 3 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-20T13:05:04.565 INFO:tasks.rados.rados.0.trial114.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2026-02-20T13:05:04.565 INFO:tasks.rados.rados.0.trial114.stdout:49: done (15 left) 2026-02-20T13:05:04.565 INFO:tasks.rados.rados.0.trial114.stdout:52: write (excl) oid 2 current snap is 0 2026-02-20T13:05:04.565 INFO:tasks.rados.rados.0.trial114.stdout:52: seq_num 51 ranges {457157=535817,1768111=402677} 2026-02-20T13:05:04.569 INFO:tasks.rados.rados.0.trial114.stdout:52: writing trial11441570-2 from 457157 to 992974 tid 1 2026-02-20T13:05:04.573 INFO:tasks.rados.rados.0.trial114.stdout:52: writing trial11441570-2 from 1768111 to 2170788 tid 2 2026-02-20T13:05:04.574 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.574 INFO:tasks.rados.rados.0.trial114.stdout:50: finishing write tid 1 to trial11441570-50 2026-02-20T13:05:04.579 INFO:tasks.rados.rados.0.trial114.stdout:46: finishing write tid 2 to trial11441570-46 2026-02-20T13:05:04.588 INFO:tasks.rados.rados.0.trial114.stdout:50: finishing write tid 2 to trial11441570-50 2026-02-20T13:05:04.588 INFO:tasks.rados.rados.0.trial114.stdout:43: finishing write tid 2 to trial11441570-43 2026-02-20T13:05:04.590 INFO:tasks.rados.rados.0.trial114.stdout:50: finishing write tid 3 to trial11441570-50 2026-02-20T13:05:04.593 INFO:tasks.rados.rados.0.trial114.stdout:50: finishing write tid 4 to trial11441570-50 2026-02-20T13:05:04.593 INFO:tasks.rados.rados.0.trial114.stdout:50: oid 50 updating version 0 to 18 2026-02-20T13:05:04.593 INFO:tasks.rados.rados.0.trial114.stdout:50: oid 50 version 18 is already newer than 16 2026-02-20T13:05:04.593 INFO:tasks.rados.rados.0.trial114.stdout:50: oid 50 version 18 is already newer than 18 2026-02-20T13:05:04.593 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 50 v 18 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-20T13:05:04.593 INFO:tasks.rados.rados.0.trial114.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2026-02-20T13:05:04.593 INFO:tasks.rados.rados.0.trial114.stdout:50: done (15 left) 2026-02-20T13:05:04.593 INFO:tasks.rados.rados.0.trial114.stdout:53: read oid 29 snap -1 2026-02-20T13:05:04.594 INFO:tasks.rados.rados.0.trial114.stdout:53: expect (ObjNum 28 snap 0 seq_num 28) 2026-02-20T13:05:04.594 INFO:tasks.rados.rados.0.trial114.stdout: waiting on 16 2026-02-20T13:05:04.595 INFO:tasks.rados.rados.0.trial114.stdout:52: finishing write tid 1 to trial11441570-2 2026-02-20T13:05:04.597 INFO:tasks.rados.rados.0.trial114.stdout:46: finishing write tid 3 to trial11441570-46 2026-02-20T13:05:04.602 INFO:tasks.rados.rados.0.trial114.stdout:46: finishing write tid 4 to trial11441570-46 2026-02-20T13:05:04.602 INFO:tasks.rados.rados.0.trial114.stdout:46: oid 46 updating version 0 to 18 2026-02-20T13:05:04.602 INFO:tasks.rados.rados.0.trial114.stdout:46: oid 46 version 18 is already newer than 16 2026-02-20T13:05:04.602 INFO:tasks.rados.rados.0.trial114.stdout:46: oid 46 version 18 is already newer than 18 2026-02-20T13:05:04.602 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 46 v 18 (ObjNum 45 snap 0 seq_num 45) dirty exists 2026-02-20T13:05:04.602 INFO:tasks.rados.rados.0.trial114.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2026-02-20T13:05:04.602 INFO:tasks.rados.rados.0.trial114.stdout:46: done (15 left) 2026-02-20T13:05:04.602 INFO:tasks.rados.rados.0.trial114.stdout:54: snap_create 2026-02-20T13:05:04.607 INFO:tasks.rados.rados.0.trial114.stdout:53: expect (ObjNum 28 snap 0 seq_num 28) 2026-02-20T13:05:04.607 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:04.630 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:04.651 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:04.673 INFO:tasks.rados.rados.0.trial114.stdout:43: finishing write tid 3 to trial11441570-43 2026-02-20T13:05:04.673 INFO:tasks.rados.rados.0.trial114.stdout:43: finishing write tid 4 to trial11441570-43 2026-02-20T13:05:04.673 INFO:tasks.rados.rados.0.trial114.stdout:43: oid 43 updating version 0 to 16 2026-02-20T13:05:04.673 INFO:tasks.rados.rados.0.trial114.stdout:43: oid 43 updating version 16 to 18 2026-02-20T13:05:04.673 INFO:tasks.rados.rados.0.trial114.stdout:43: oid 43 version 18 is already newer than 18 2026-02-20T13:05:04.673 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 43 v 18 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:44: finishing write tid 1 to trial11441570-44 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:52: finishing write tid 2 to trial11441570-2 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:11: finishing write tid 1 to trial11441570-11 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:51: finishing write tid 1 to trial11441570-28 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:14: finishing write tid 1 to trial11441570-14 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:52: finishing write tid 3 to trial11441570-2 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:52: finishing write tid 4 to trial11441570-2 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:52: oid 2 updating version 0 to 9 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:52: oid 2 version 9 is already newer than 7 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:52: oid 2 version 9 is already newer than 9 2026-02-20T13:05:04.674 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 2 v 9 (ObjNum 51 snap 0 seq_num 51) dirty exists 2026-02-20T13:05:04.675 INFO:tasks.rados.rados.0.trial114.stdout:52: left oid 2 (ObjNum 51 snap 0 seq_num 51) 2026-02-20T13:05:04.675 INFO:tasks.rados.rados.0.trial114.stdout:13: finishing write tid 1 to trial11441570-13 2026-02-20T13:05:04.675 INFO:tasks.rados.rados.0.trial114.stdout:14: finishing write tid 2 to trial11441570-14 2026-02-20T13:05:04.675 INFO:tasks.rados.rados.0.trial114.stdout:44: finishing write tid 2 to trial11441570-44 2026-02-20T13:05:04.675 INFO:tasks.rados.rados.0.trial114.stdout:14: finishing write tid 3 to trial11441570-14 2026-02-20T13:05:04.675 INFO:tasks.rados.rados.0.trial114.stdout:51: finishing write tid 2 to trial11441570-28 2026-02-20T13:05:04.675 INFO:tasks.rados.rados.0.trial114.stdout:14: finishing write tid 4 to trial11441570-14 2026-02-20T13:05:04.675 INFO:tasks.rados.rados.0.trial114.stdout:14: oid 14 updating version 0 to 3 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:14: oid 14 version 3 is already newer than 3 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:14: oid 14 version 3 is already newer than 1 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 14 v 3 (ObjNum 13 snap 0 seq_num 13) dirty exists 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:44: finishing write tid 3 to trial11441570-44 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:44: finishing write tid 4 to trial11441570-44 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:44: oid 44 updating version 0 to 21 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:44: oid 44 version 21 is already newer than 21 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:44: oid 44 version 21 is already newer than 19 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 21 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-20T13:05:04.676 INFO:tasks.rados.rados.0.trial114.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2026-02-20T13:05:04.677 INFO:tasks.rados.rados.0.trial114.stdout:1: finishing write tid 1 to trial11441570-1 2026-02-20T13:05:04.677 INFO:tasks.rados.rados.0.trial114.stdout:51: finishing write tid 3 to trial11441570-28 2026-02-20T13:05:04.681 INFO:tasks.rados.rados.0.trial114.stdout:13: finishing write tid 2 to trial11441570-13 2026-02-20T13:05:04.682 INFO:tasks.rados.rados.0.trial114.stdout:51: finishing write tid 4 to trial11441570-28 2026-02-20T13:05:04.684 INFO:tasks.rados.rados.0.trial114.stdout:51: finishing write tid 5 to trial11441570-28 2026-02-20T13:05:04.685 INFO:tasks.rados.rados.0.trial114.stdout:51: oid 28 updating version 0 to 22 2026-02-20T13:05:04.685 INFO:tasks.rados.rados.0.trial114.stdout:51: oid 28 version 22 is already newer than 22 2026-02-20T13:05:04.685 INFO:tasks.rados.rados.0.trial114.stdout:51: oid 28 version 22 is already newer than 19 2026-02-20T13:05:04.685 INFO:tasks.rados.rados.0.trial114.stdout:51: oid 28 version 22 is already newer than 22 2026-02-20T13:05:04.685 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 28 v 22 (ObjNum 50 snap 0 seq_num 50) dirty exists 2026-02-20T13:05:04.685 INFO:tasks.rados.rados.0.trial114.stdout:51: left oid 28 (ObjNum 50 snap 0 seq_num 50) 2026-02-20T13:05:04.688 INFO:tasks.rados.rados.0.trial114.stdout:1: finishing write tid 2 to trial11441570-1 2026-02-20T13:05:04.692 INFO:tasks.rados.rados.0.trial114.stdout:1: finishing write tid 3 to trial11441570-1 2026-02-20T13:05:04.693 INFO:tasks.rados.rados.0.trial114.stdout:13: finishing write tid 3 to trial11441570-13 2026-02-20T13:05:04.694 INFO:tasks.rados.rados.0.trial114.stdout:1: finishing write tid 4 to trial11441570-1 2026-02-20T13:05:04.695 INFO:tasks.rados.rados.0.trial114.stdout:1: oid 1 updating version 0 to 1 2026-02-20T13:05:04.695 INFO:tasks.rados.rados.0.trial114.stdout:1: oid 1 updating version 1 to 3 2026-02-20T13:05:04.695 INFO:tasks.rados.rados.0.trial114.stdout:1: oid 1 version 3 is already newer than 3 2026-02-20T13:05:04.695 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2026-02-20T13:05:04.695 INFO:tasks.rados.rados.0.trial114.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2026-02-20T13:05:04.699 INFO:tasks.rados.rados.0.trial114.stdout:13: finishing write tid 4 to trial11441570-13 2026-02-20T13:05:04.699 INFO:tasks.rados.rados.0.trial114.stdout:13: oid 13 updating version 0 to 1 2026-02-20T13:05:04.699 INFO:tasks.rados.rados.0.trial114.stdout:13: oid 13 updating version 1 to 3 2026-02-20T13:05:04.699 INFO:tasks.rados.rados.0.trial114.stdout:13: oid 13 version 3 is already newer than 3 2026-02-20T13:05:04.699 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 13 v 3 (ObjNum 12 snap 0 seq_num 12) dirty exists 2026-02-20T13:05:04.699 INFO:tasks.rados.rados.0.trial114.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2026-02-20T13:05:04.699 INFO:tasks.rados.rados.0.trial114.stdout:17: finishing write tid 1 to trial11441570-17 2026-02-20T13:05:04.704 INFO:tasks.rados.rados.0.trial114.stdout:47: finishing write tid 1 to trial11441570-47 2026-02-20T13:05:04.707 INFO:tasks.rados.rados.0.trial114.stdout:11: finishing write tid 2 to trial11441570-11 2026-02-20T13:05:04.709 INFO:tasks.rados.rados.0.trial114.stdout:17: finishing write tid 2 to trial11441570-17 2026-02-20T13:05:04.712 INFO:tasks.rados.rados.0.trial114.stdout:17: finishing write tid 3 to trial11441570-17 2026-02-20T13:05:04.713 INFO:tasks.rados.rados.0.trial114.stdout:17: finishing write tid 4 to trial11441570-17 2026-02-20T13:05:04.713 INFO:tasks.rados.rados.0.trial114.stdout:17: oid 17 updating version 0 to 6 2026-02-20T13:05:04.713 INFO:tasks.rados.rados.0.trial114.stdout:17: oid 17 version 6 is already newer than 6 2026-02-20T13:05:04.713 INFO:tasks.rados.rados.0.trial114.stdout:17: oid 17 version 6 is already newer than 4 2026-02-20T13:05:04.713 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 17 v 6 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-20T13:05:04.713 INFO:tasks.rados.rados.0.trial114.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2026-02-20T13:05:04.717 INFO:tasks.rados.rados.0.trial114.stdout:11: finishing write tid 3 to trial11441570-11 2026-02-20T13:05:04.717 INFO:tasks.rados.rados.0.trial114.stdout:47: finishing write tid 2 to trial11441570-47 2026-02-20T13:05:04.720 INFO:tasks.rados.rados.0.trial114.stdout:47: finishing write tid 3 to trial11441570-47 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:11: finishing write tid 4 to trial11441570-11 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:11: oid 11 updating version 0 to 3 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:11: oid 11 version 3 is already newer than 1 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:11: oid 11 version 3 is already newer than 3 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 11 v 3 (ObjNum 10 snap 0 seq_num 10) dirty exists 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:47: finishing write tid 4 to trial11441570-47 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:47: oid 47 updating version 0 to 6 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:47: oid 47 version 6 is already newer than 4 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:47: oid 47 version 6 is already newer than 6 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 47 v 6 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-20T13:05:04.722 INFO:tasks.rados.rados.0.trial114.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2026-02-20T13:05:04.729 INFO:tasks.rados.rados.0.trial114.stdout:15: finishing write tid 1 to trial11441570-15 2026-02-20T13:05:04.742 INFO:tasks.rados.rados.0.trial114.stdout:22: finishing write tid 1 to trial11441570-22 2026-02-20T13:05:04.756 INFO:tasks.rados.rados.0.trial114.stdout:15: finishing write tid 2 to trial11441570-15 2026-02-20T13:05:04.764 INFO:tasks.rados.rados.0.trial114.stdout:15: finishing write tid 3 to trial11441570-15 2026-02-20T13:05:04.768 INFO:tasks.rados.rados.0.trial114.stdout:15: finishing write tid 4 to trial11441570-15 2026-02-20T13:05:04.768 INFO:tasks.rados.rados.0.trial114.stdout:15: oid 15 updating version 0 to 4 2026-02-20T13:05:04.768 INFO:tasks.rados.rados.0.trial114.stdout:15: oid 15 updating version 4 to 6 2026-02-20T13:05:04.768 INFO:tasks.rados.rados.0.trial114.stdout:15: oid 15 version 6 is already newer than 6 2026-02-20T13:05:04.768 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 15 v 6 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-20T13:05:04.768 INFO:tasks.rados.rados.0.trial114.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2026-02-20T13:05:04.773 INFO:tasks.rados.rados.0.trial114.stdout:20: finishing write tid 1 to trial11441570-20 2026-02-20T13:05:04.784 INFO:tasks.rados.rados.0.trial114.stdout:22: finishing write tid 2 to trial11441570-22 2026-02-20T13:05:04.791 INFO:tasks.rados.rados.0.trial114.stdout:22: finishing write tid 3 to trial11441570-22 2026-02-20T13:05:04.795 INFO:tasks.rados.rados.0.trial114.stdout:22: finishing write tid 4 to trial11441570-22 2026-02-20T13:05:04.795 INFO:tasks.rados.rados.0.trial114.stdout:22: oid 22 updating version 0 to 6 2026-02-20T13:05:04.795 INFO:tasks.rados.rados.0.trial114.stdout:22: oid 22 version 6 is already newer than 6 2026-02-20T13:05:04.795 INFO:tasks.rados.rados.0.trial114.stdout:22: oid 22 version 6 is already newer than 4 2026-02-20T13:05:04.795 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-20T13:05:04.795 INFO:tasks.rados.rados.0.trial114.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2026-02-20T13:05:04.801 INFO:tasks.rados.rados.0.trial114.stdout:20: finishing write tid 2 to trial11441570-20 2026-02-20T13:05:04.807 INFO:tasks.rados.rados.0.trial114.stdout:20: finishing write tid 3 to trial11441570-20 2026-02-20T13:05:04.810 INFO:tasks.rados.rados.0.trial114.stdout:20: finishing write tid 4 to trial11441570-20 2026-02-20T13:05:04.810 INFO:tasks.rados.rados.0.trial114.stdout:20: oid 20 updating version 0 to 7 2026-02-20T13:05:04.811 INFO:tasks.rados.rados.0.trial114.stdout:20: oid 20 updating version 7 to 9 2026-02-20T13:05:04.811 INFO:tasks.rados.rados.0.trial114.stdout:20: oid 20 version 9 is already newer than 9 2026-02-20T13:05:04.811 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 20 v 9 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-20T13:05:04.811 INFO:tasks.rados.rados.0.trial114.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2026-02-20T13:05:04.814 INFO:tasks.rados.rados.0.trial114.stdout:25: finishing write tid 1 to trial11441570-25 2026-02-20T13:05:04.824 INFO:tasks.rados.rados.0.trial114.stdout:25: finishing write tid 2 to trial11441570-25 2026-02-20T13:05:04.828 INFO:tasks.rados.rados.0.trial114.stdout:25: finishing write tid 3 to trial11441570-25 2026-02-20T13:05:04.830 INFO:tasks.rados.rados.0.trial114.stdout:25: finishing write tid 4 to trial11441570-25 2026-02-20T13:05:04.830 INFO:tasks.rados.rados.0.trial114.stdout:25: oid 25 updating version 0 to 9 2026-02-20T13:05:04.830 INFO:tasks.rados.rados.0.trial114.stdout:25: oid 25 version 9 is already newer than 9 2026-02-20T13:05:04.830 INFO:tasks.rados.rados.0.trial114.stdout:25: oid 25 version 9 is already newer than 7 2026-02-20T13:05:04.830 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 25 v 9 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-20T13:05:04.831 INFO:tasks.rados.rados.0.trial114.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:1: done (15 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:11: done (14 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:13: done (13 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:14: done (12 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:15: done (11 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:17: done (10 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:20: done (9 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:22: done (8 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:25: done (7 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:43: done (6 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:44: done (5 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:47: done (4 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:51: done (3 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:52: done (2 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:53: done (1 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:54: done (0 left) 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:55: write (excl) oid 3 current snap is 1 2026-02-20T13:05:04.945 INFO:tasks.rados.rados.0.trial114.stdout:55: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2026-02-20T13:05:04.949 INFO:tasks.rados.rados.0.trial114.stdout:55: writing trial11441570-3 from 473964 to 1085030 tid 1 2026-02-20T13:05:04.954 INFO:tasks.rados.rados.0.trial114.stdout:55: writing trial11441570-3 from 1826593 to 2372928 tid 2 2026-02-20T13:05:04.957 INFO:tasks.rados.rados.0.trial114.stdout:55: writing trial11441570-3 from 2778819 to 2873964 tid 3 2026-02-20T13:05:04.957 INFO:tasks.rados.rados.0.trial114.stdout:56: read oid 12 snap 0 2026-02-20T13:05:04.957 INFO:tasks.rados.rados.0.trial114.stdout:56: expect (ObjNum 11 snap 0 seq_num 11) 2026-02-20T13:05:04.957 INFO:tasks.rados.rados.0.trial114.stdout:57: delete oid 38 current snap is 1 2026-02-20T13:05:04.971 INFO:tasks.rados.rados.0.trial114.stdout:56: expect (ObjNum 11 snap 0 seq_num 11) 2026-02-20T13:05:04.986 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1809730 2026-02-20T13:05:04.999 INFO:tasks.rados.rados.0.trial114.stdout:55: finishing write tid 1 to trial11441570-3 2026-02-20T13:05:05.007 INFO:tasks.rados.rados.0.trial114.stdout:55: finishing write tid 2 to trial11441570-3 2026-02-20T13:05:05.016 INFO:tasks.rados.rados.0.trial114.stdout:55: finishing write tid 3 to trial11441570-3 2026-02-20T13:05:05.027 INFO:tasks.rados.rados.0.trial114.stdout:55: finishing write tid 4 to trial11441570-3 2026-02-20T13:05:05.030 INFO:tasks.rados.rados.0.trial114.stdout:55: finishing write tid 5 to trial11441570-3 2026-02-20T13:05:05.030 INFO:tasks.rados.rados.0.trial114.stdout:55: oid 3 updating version 0 to 17 2026-02-20T13:05:05.030 INFO:tasks.rados.rados.0.trial114.stdout:55: oid 3 version 17 is already newer than 17 2026-02-20T13:05:05.030 INFO:tasks.rados.rados.0.trial114.stdout:55: oid 3 version 17 is already newer than 14 2026-02-20T13:05:05.030 INFO:tasks.rados.rados.0.trial114.stdout:55: oid 3 version 17 is already newer than 17 2026-02-20T13:05:05.030 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 3 v 17 (ObjNum 52 snap 1 seq_num 52) dirty exists 2026-02-20T13:05:05.030 INFO:tasks.rados.rados.0.trial114.stdout:55: left oid 3 (ObjNum 52 snap 1 seq_num 52) 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:55: done (2 left) 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:56: done (1 left) 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:57: done (0 left) 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:58: read oid 15 snap -1 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:58: expect (ObjNum 14 snap 0 seq_num 14) 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:59: read oid 24 snap -1 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:59: expect (ObjNum 23 snap 0 seq_num 23) 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:60: read oid 41 snap -1 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:60: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:61: read oid 25 snap -1 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:61: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:62: read oid 4 snap -1 2026-02-20T13:05:05.040 INFO:tasks.rados.rados.0.trial114.stdout:62: expect (ObjNum 3 snap 0 seq_num 3) 2026-02-20T13:05:05.041 INFO:tasks.rados.rados.0.trial114.stdout:63: write (excl) oid 27 current snap is 1 2026-02-20T13:05:05.041 INFO:tasks.rados.rados.0.trial114.stdout:63: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2026-02-20T13:05:05.045 INFO:tasks.rados.rados.0.trial114.stdout:63: writing trial11441570-27 from 507578 to 985495 tid 1 2026-02-20T13:05:05.049 INFO:tasks.rados.rados.0.trial114.stdout:63: writing trial11441570-27 from 1543557 to 2093561 tid 2 2026-02-20T13:05:05.052 INFO:tasks.rados.rados.0.trial114.stdout:63: writing trial11441570-27 from 2833665 to 2907578 tid 3 2026-02-20T13:05:05.052 INFO:tasks.rados.rados.0.trial114.stdout:64: snap_create 2026-02-20T13:05:05.053 INFO:tasks.rados.rados.0.trial114.stdout:59: expect (ObjNum 23 snap 0 seq_num 23) 2026-02-20T13:05:05.102 INFO:tasks.rados.rados.0.trial114.stdout:62: expect (ObjNum 3 snap 0 seq_num 3) 2026-02-20T13:05:05.132 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:05.149 INFO:tasks.rados.rados.0.trial114.stdout:60: expect (ObjNum 40 snap 0 seq_num 40) 2026-02-20T13:05:05.149 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:05.177 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1394566 2026-02-20T13:05:05.202 INFO:tasks.rados.rados.0.trial114.stdout:63: finishing write tid 1 to trial11441570-27 2026-02-20T13:05:05.202 INFO:tasks.rados.rados.0.trial114.stdout:58: expect (ObjNum 14 snap 0 seq_num 14) 2026-02-20T13:05:05.202 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 115441 2026-02-20T13:05:05.221 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 412728 2026-02-20T13:05:05.258 INFO:tasks.rados.rados.0.trial114.stdout:61: expect (ObjNum 24 snap 0 seq_num 24) 2026-02-20T13:05:05.279 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 849462 2026-02-20T13:05:05.310 INFO:tasks.rados.rados.0.trial114.stdout:63: finishing write tid 2 to trial11441570-27 2026-02-20T13:05:05.310 INFO:tasks.rados.rados.0.trial114.stdout:63: finishing write tid 3 to trial11441570-27 2026-02-20T13:05:05.310 INFO:tasks.rados.rados.0.trial114.stdout:63: finishing write tid 4 to trial11441570-27 2026-02-20T13:05:05.310 INFO:tasks.rados.rados.0.trial114.stdout:63: finishing write tid 5 to trial11441570-27 2026-02-20T13:05:05.310 INFO:tasks.rados.rados.0.trial114.stdout:63: oid 27 updating version 0 to 29 2026-02-20T13:05:05.310 INFO:tasks.rados.rados.0.trial114.stdout:63: oid 27 version 29 is already newer than 29 2026-02-20T13:05:05.310 INFO:tasks.rados.rados.0.trial114.stdout:63: oid 27 version 29 is already newer than 26 2026-02-20T13:05:05.311 INFO:tasks.rados.rados.0.trial114.stdout:63: oid 27 version 29 is already newer than 29 2026-02-20T13:05:05.311 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 27 v 29 (ObjNum 54 snap 1 seq_num 54) dirty exists 2026-02-20T13:05:05.311 INFO:tasks.rados.rados.0.trial114.stdout:63: left oid 27 (ObjNum 54 snap 1 seq_num 54) 2026-02-20T13:05:05.940 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:05:05.941 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:05:05.949 INFO:tasks.rados.rados.0.trial114.stdout:58: done (6 left) 2026-02-20T13:05:05.950 INFO:tasks.rados.rados.0.trial114.stdout:59: done (5 left) 2026-02-20T13:05:05.950 INFO:tasks.rados.rados.0.trial114.stdout:60: done (4 left) 2026-02-20T13:05:05.950 INFO:tasks.rados.rados.0.trial114.stdout:61: done (3 left) 2026-02-20T13:05:05.950 INFO:tasks.rados.rados.0.trial114.stdout:62: done (2 left) 2026-02-20T13:05:05.950 INFO:tasks.rados.rados.0.trial114.stdout:63: done (1 left) 2026-02-20T13:05:05.950 INFO:tasks.rados.rados.0.trial114.stdout:64: done (0 left) 2026-02-20T13:05:05.950 INFO:tasks.rados.rados.0.trial114.stdout:65: write oid 45 current snap is 2 2026-02-20T13:05:05.950 INFO:tasks.rados.rados.0.trial114.stdout:65: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2026-02-20T13:05:05.954 INFO:tasks.rados.rados.0.trial114.stdout:65: writing trial11441570-45 from 524385 to 1077551 tid 1 2026-02-20T13:05:05.958 INFO:tasks.rados.rados.0.trial114.stdout:65: writing trial11441570-45 from 1602039 to 2012054 tid 2 2026-02-20T13:05:05.962 INFO:tasks.rados.rados.0.trial114.stdout:65: writing trial11441570-45 from 2577441 to 2924385 tid 3 2026-02-20T13:05:05.962 INFO:tasks.rados.rados.0.trial114.stdout:66: read oid 16 snap -1 2026-02-20T13:05:05.962 INFO:tasks.rados.rados.0.trial114.stdout:66: expect (ObjNum 15 snap 0 seq_num 15) 2026-02-20T13:05:05.962 INFO:tasks.rados.rados.0.trial114.stdout:67: write oid 44 current snap is 2 2026-02-20T13:05:05.962 INFO:tasks.rados.rados.0.trial114.stdout:67: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2026-02-20T13:05:05.966 INFO:tasks.rados.rados.0.trial114.stdout:67: writing trial11441570-44 from 541192 to 1169607 tid 1 2026-02-20T13:05:05.970 INFO:tasks.rados.rados.0.trial114.stdout:67: writing trial11441570-44 from 1660521 to 2214194 tid 2 2026-02-20T13:05:05.973 INFO:tasks.rados.rados.0.trial114.stdout:67: writing trial11441570-44 from 2888511 to 2941192 tid 3 2026-02-20T13:05:05.973 INFO:tasks.rados.rados.0.trial114.stdout:68: read oid 48 snap -1 2026-02-20T13:05:05.973 INFO:tasks.rados.rados.0.trial114.stdout:68: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-20T13:05:05.973 INFO:tasks.rados.rados.0.trial114.stdout:69: delete oid 31 current snap is 2 2026-02-20T13:05:05.990 INFO:tasks.rados.rados.0.trial114.stdout:68: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-20T13:05:05.990 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:06.018 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1154049 2026-02-20T13:05:06.034 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 999652 2026-02-20T13:05:06.049 INFO:tasks.rados.rados.0.trial114.stdout:65: finishing write tid 1 to trial11441570-45 2026-02-20T13:05:06.049 INFO:tasks.rados.rados.0.trial114.stdout:65: finishing write tid 2 to trial11441570-45 2026-02-20T13:05:06.049 INFO:tasks.rados.rados.0.trial114.stdout:66: expect (ObjNum 15 snap 0 seq_num 15) 2026-02-20T13:05:06.049 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:65: finishing write tid 3 to trial11441570-45 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:65: finishing write tid 4 to trial11441570-45 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:65: finishing write tid 5 to trial11441570-45 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:65: oid 45 updating version 0 to 23 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:65: oid 45 version 23 is already newer than 23 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:65: oid 45 version 23 is already newer than 23 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:65: oid 45 version 23 is already newer than 23 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 45 v 23 (ObjNum 55 snap 2 seq_num 55) dirty exists 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:65: left oid 45 (ObjNum 55 snap 2 seq_num 55) 2026-02-20T13:05:06.109 INFO:tasks.rados.rados.0.trial114.stdout:67: finishing write tid 1 to trial11441570-44 2026-02-20T13:05:06.110 INFO:tasks.rados.rados.0.trial114.stdout:65: done (4 left) 2026-02-20T13:05:06.110 INFO:tasks.rados.rados.0.trial114.stdout:66: done (3 left) 2026-02-20T13:05:06.110 INFO:tasks.rados.rados.0.trial114.stdout:68: done (2 left) 2026-02-20T13:05:06.110 INFO:tasks.rados.rados.0.trial114.stdout:69: done (1 left) 2026-02-20T13:05:06.110 INFO:tasks.rados.rados.0.trial114.stdout:70: snap_remove snap 1 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:70: done (1 left) 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:71: read oid 6 snap -1 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:71: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:72: read oid 36 snap -1 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:72: expect (ObjNum 35 snap 0 seq_num 35) 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:73: read oid 48 snap -1 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:73: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:74: read oid 15 snap -1 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:74: expect (ObjNum 14 snap 0 seq_num 14) 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:75: read oid 19 snap 0 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:75: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:76: write oid 29 current snap is 2 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:67: finishing write tid 2 to trial11441570-44 2026-02-20T13:05:06.953 INFO:tasks.rados.rados.0.trial114.stdout:76: seq_num 58 ranges {574806=778913,2061132=557342} 2026-02-20T13:05:06.958 INFO:tasks.rados.rados.0.trial114.stdout:76: writing trial11441570-29 from 574806 to 1353719 tid 1 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:76: writing trial11441570-29 from 2061132 to 2618474 tid 2 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:77: read oid 32 snap 0 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:77: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:78: delete oid 13 current snap is 2 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:67: finishing write tid 3 to trial11441570-44 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:67: finishing write tid 4 to trial11441570-44 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:67: finishing write tid 5 to trial11441570-44 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:67: oid 44 updating version 0 to 26 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:67: oid 44 version 26 is already newer than 26 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:67: oid 44 version 26 is already newer than 26 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:67: oid 44 version 26 is already newer than 26 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 26 (ObjNum 56 snap 2 seq_num 56) dirty exists 2026-02-20T13:05:06.964 INFO:tasks.rados.rados.0.trial114.stdout:67: left oid 44 (ObjNum 56 snap 2 seq_num 56) 2026-02-20T13:05:06.994 INFO:tasks.rados.rados.0.trial114.stdout:71: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-20T13:05:07.014 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1308088 2026-02-20T13:05:07.026 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1664868 2026-02-20T13:05:07.035 INFO:tasks.rados.rados.0.trial114.stdout:67: done (8 left) 2026-02-20T13:05:07.035 INFO:tasks.rados.rados.0.trial114.stdout:71: done (7 left) 2026-02-20T13:05:07.035 INFO:tasks.rados.rados.0.trial114.stdout:78: done (6 left) 2026-02-20T13:05:07.035 INFO:tasks.rados.rados.0.trial114.stdout:79: read oid 1 snap -1 2026-02-20T13:05:07.035 INFO:tasks.rados.rados.0.trial114.stdout:79: expect (ObjNum 0 snap 0 seq_num 0) 2026-02-20T13:05:07.035 INFO:tasks.rados.rados.0.trial114.stdout:80: write oid 31 current snap is 2 2026-02-20T13:05:07.035 INFO:tasks.rados.rados.0.trial114.stdout:72: expect (ObjNum 35 snap 0 seq_num 35) 2026-02-20T13:05:07.047 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1456490 2026-02-20T13:05:07.060 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:07.082 INFO:tasks.rados.rados.0.trial114.stdout:77: expect (ObjNum 31 snap 0 seq_num 31) 2026-02-20T13:05:07.090 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2220297 2026-02-20T13:05:07.098 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1302370 2026-02-20T13:05:07.123 INFO:tasks.rados.rados.0.trial114.stdout:75: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-20T13:05:07.123 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:07.142 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:07.162 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:07.181 INFO:tasks.rados.rados.0.trial114.stdout:73: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-20T13:05:07.181 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:07.251 INFO:tasks.rados.rados.0.trial114.stdout:74: expect (ObjNum 14 snap 0 seq_num 14) 2026-02-20T13:05:07.275 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 639937 2026-02-20T13:05:07.288 INFO:tasks.rados.rados.0.trial114.stdout:76: finishing write tid 1 to trial11441570-29 2026-02-20T13:05:07.288 INFO:tasks.rados.rados.0.trial114.stdout:76: finishing write tid 2 to trial11441570-29 2026-02-20T13:05:07.289 INFO:tasks.rados.rados.0.trial114.stdout:80: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2026-02-20T13:05:07.292 INFO:tasks.rados.rados.0.trial114.stdout:80: writing trial11441570-31 from 608420 to 1137831 tid 1 2026-02-20T13:05:07.297 INFO:tasks.rados.rados.0.trial114.stdout:80: writing trial11441570-31 from 1778096 to 2339107 tid 2 2026-02-20T13:05:07.300 INFO:tasks.rados.rados.0.trial114.stdout:80: writing trial11441570-31 from 2881850 to 3008420 tid 3 2026-02-20T13:05:07.300 INFO:tasks.rados.rados.0.trial114.stdout:72: done (7 left) 2026-02-20T13:05:07.300 INFO:tasks.rados.rados.0.trial114.stdout:73: done (6 left) 2026-02-20T13:05:07.300 INFO:tasks.rados.rados.0.trial114.stdout:74: done (5 left) 2026-02-20T13:05:07.300 INFO:tasks.rados.rados.0.trial114.stdout:75: done (4 left) 2026-02-20T13:05:07.300 INFO:tasks.rados.rados.0.trial114.stdout:77: done (3 left) 2026-02-20T13:05:07.301 INFO:tasks.rados.rados.0.trial114.stdout:81: delete oid 38 current snap is 2 2026-02-20T13:05:07.301 INFO:tasks.rados.rados.0.trial114.stdout:76: finishing write tid 3 to trial11441570-29 2026-02-20T13:05:07.301 INFO:tasks.rados.rados.0.trial114.stdout:79: expect (ObjNum 0 snap 0 seq_num 0) 2026-02-20T13:05:07.324 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1948524 2026-02-20T13:05:07.324 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:07.342 INFO:tasks.rados.rados.0.trial114.stdout:76: finishing write tid 4 to trial11441570-29 2026-02-20T13:05:07.342 INFO:tasks.rados.rados.0.trial114.stdout:76: oid 29 updating version 0 to 22 2026-02-20T13:05:07.342 INFO:tasks.rados.rados.0.trial114.stdout:76: oid 29 version 22 is already newer than 22 2026-02-20T13:05:07.342 INFO:tasks.rados.rados.0.trial114.stdout:76: oid 29 version 22 is already newer than 22 2026-02-20T13:05:07.342 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 29 v 22 (ObjNum 58 snap 2 seq_num 58) dirty exists 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:76: left oid 29 (ObjNum 58 snap 2 seq_num 58) 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:80: finishing write tid 1 to trial11441570-31 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:80: finishing write tid 2 to trial11441570-31 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:76: done (3 left) 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:79: done (2 left) 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:81: done (1 left) 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:82: snap_create 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:80: finishing write tid 3 to trial11441570-31 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:80: finishing write tid 4 to trial11441570-31 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:80: finishing write tid 5 to trial11441570-31 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:80: oid 31 updating version 0 to 25 2026-02-20T13:05:07.343 INFO:tasks.rados.rados.0.trial114.stdout:80: oid 31 version 25 is already newer than 25 2026-02-20T13:05:07.344 INFO:tasks.rados.rados.0.trial114.stdout:80: oid 31 version 25 is already newer than 25 2026-02-20T13:05:07.344 INFO:tasks.rados.rados.0.trial114.stdout:80: oid 31 version 25 is already newer than 25 2026-02-20T13:05:07.344 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 31 v 25 (ObjNum 60 snap 2 seq_num 60) dirty exists 2026-02-20T13:05:07.344 INFO:tasks.rados.rados.0.trial114.stdout:80: left oid 31 (ObjNum 60 snap 2 seq_num 60) 2026-02-20T13:05:07.942 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:05:07.955 INFO:tasks.rados.rados.0.trial114.stdout:80: done (1 left) 2026-02-20T13:05:07.956 INFO:tasks.rados.rados.0.trial114.stdout:82: done (0 left) 2026-02-20T13:05:07.956 INFO:tasks.rados.rados.0.trial114.stdout:83: delete oid 42 current snap is 3 2026-02-20T13:05:07.975 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [2, 3, 0, 1] 2026-02-20T13:05:07.975 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:05:07.976 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [2, 3, 0, 1] 2026-02-20T13:05:07.976 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T13:05:07.976 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:05:08.021 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:08.017+0000 7fd8c7fcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:08.024 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:08.022+0000 7fd8c7fcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:08.057 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T13:05:13.058 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [1] live_osds: [2, 3, 0] 2026-02-20T13:05:13.058 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:05:13.058 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2026-02-20T13:05:13.058 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T13:05:13.058 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T13:05:13.060 INFO:tasks.ceph.osd.1:Started 2026-02-20T13:05:13.060 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-20T13:05:13.130 INFO:teuthology.orchestra.run.trial114.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:05:13.132 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:05:13.133 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2026-02-20T13:05:18.133 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-20T13:05:18.327 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-20T13:05:18.404 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:05:18.405 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:05:19.339 INFO:teuthology.orchestra.run.trial114.stdout:{ 2026-02-20T13:05:19.340 INFO:teuthology.orchestra.run.trial114.stdout: "ops_in_flight": [] 2026-02-20T13:05:19.340 INFO:teuthology.orchestra.run.trial114.stdout:} 2026-02-20T13:05:20.405 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:05:20.485 INFO:tasks.rados.rados.0.trial114.stdout:83: done (0 left) 2026-02-20T13:05:20.486 INFO:tasks.rados.rados.0.trial114.stdout:84: read oid 48 snap 2 2026-02-20T13:05:20.486 INFO:tasks.rados.rados.0.trial114.stdout:84: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-20T13:05:20.486 INFO:tasks.rados.rados.0.trial114.stdout:85: delete oid 5 current snap is 3 2026-02-20T13:05:20.492 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:20.487+0000 7fd5d3b83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:20.494 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:20.491+0000 7fd5d3b83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:20.500 INFO:tasks.rados.rados.0.trial114.stdout:84: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-20T13:05:20.528 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:20.552 INFO:tasks.rados.rados.0.trial114.stdout:84: done (1 left) 2026-02-20T13:05:20.552 INFO:tasks.rados.rados.0.trial114.stdout:85: done (0 left) 2026-02-20T13:05:20.552 INFO:tasks.rados.rados.0.trial114.stdout:86: snap_create 2026-02-20T13:05:21.341 INFO:tasks.rados.rados.0.trial114.stdout:86: done (0 left) 2026-02-20T13:05:21.341 INFO:tasks.rados.rados.0.trial114.stdout:87: delete oid 19 current snap is 4 2026-02-20T13:05:21.382 INFO:tasks.rados.rados.0.trial114.stdout:87: done (0 left) 2026-02-20T13:05:21.382 INFO:tasks.rados.rados.0.trial114.stdout:88: read oid 2 snap -1 2026-02-20T13:05:21.382 INFO:tasks.rados.rados.0.trial114.stdout:88: expect (ObjNum 51 snap 0 seq_num 51) 2026-02-20T13:05:21.382 INFO:tasks.rados.rados.0.trial114.stdout:89: write (excl) oid 50 current snap is 4 2026-02-20T13:05:21.382 INFO:tasks.rados.rados.0.trial114.stdout:89: seq_num 65 ranges {692455=622009,2070506=712007} 2026-02-20T13:05:21.386 INFO:tasks.rados.rados.0.trial114.stdout:89: writing trial11441570-50 from 692455 to 1314464 tid 1 2026-02-20T13:05:21.392 INFO:tasks.rados.rados.0.trial114.stdout:89: writing trial11441570-50 from 2070506 to 2782513 tid 2 2026-02-20T13:05:21.392 INFO:tasks.rados.rados.0.trial114.stdout:90: read oid 6 snap -1 2026-02-20T13:05:21.392 INFO:tasks.rados.rados.0.trial114.stdout:90: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-20T13:05:21.392 INFO:tasks.rados.rados.0.trial114.stdout:91: snap_remove snap 3 2026-02-20T13:05:22.345 INFO:tasks.rados.rados.0.trial114.stdout:91: done (3 left) 2026-02-20T13:05:22.345 INFO:tasks.rados.rados.0.trial114.stdout:92: read oid 8 snap -1 2026-02-20T13:05:22.345 INFO:tasks.rados.rados.0.trial114.stdout:92: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-20T13:05:22.345 INFO:tasks.rados.rados.0.trial114.stdout:93: read oid 14 snap -1 2026-02-20T13:05:22.345 INFO:tasks.rados.rados.0.trial114.stdout:93: expect (ObjNum 13 snap 0 seq_num 13) 2026-02-20T13:05:22.345 INFO:tasks.rados.rados.0.trial114.stdout:94: snap_create 2026-02-20T13:05:22.345 INFO:tasks.rados.rados.0.trial114.stdout:88: expect (ObjNum 51 snap 0 seq_num 51) 2026-02-20T13:05:22.345 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:22.428 INFO:tasks.rados.rados.0.trial114.stdout:89: finishing write tid 1 to trial11441570-50 2026-02-20T13:05:22.428 INFO:tasks.rados.rados.0.trial114.stdout:89: finishing write tid 2 to trial11441570-50 2026-02-20T13:05:22.428 INFO:tasks.rados.rados.0.trial114.stdout:89: finishing write tid 3 to trial11441570-50 2026-02-20T13:05:22.428 INFO:tasks.rados.rados.0.trial114.stdout:89: finishing write tid 4 to trial11441570-50 2026-02-20T13:05:22.429 INFO:tasks.rados.rados.0.trial114.stdout:89: oid 50 updating version 0 to 28 2026-02-20T13:05:22.429 INFO:tasks.rados.rados.0.trial114.stdout:89: oid 50 version 28 is already newer than 26 2026-02-20T13:05:22.429 INFO:tasks.rados.rados.0.trial114.stdout:89: oid 50 version 28 is already newer than 28 2026-02-20T13:05:22.429 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 50 v 28 (ObjNum 65 snap 4 seq_num 65) dirty exists 2026-02-20T13:05:22.429 INFO:tasks.rados.rados.0.trial114.stdout:89: left oid 50 (ObjNum 65 snap 4 seq_num 65) 2026-02-20T13:05:22.429 INFO:tasks.rados.rados.0.trial114.stdout:90: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-20T13:05:22.447 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 516662 2026-02-20T13:05:22.479 INFO:tasks.rados.rados.0.trial114.stdout:92: expect (ObjNum 7 snap 0 seq_num 7) 2026-02-20T13:05:22.496 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:22.514 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:22.532 INFO:tasks.rados.rados.0.trial114.stdout:93: expect (ObjNum 13 snap 0 seq_num 13) 2026-02-20T13:05:22.572 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:05:22.648 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:22.643+0000 7f5a8068b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:22.650 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:22.646+0000 7f5a8068b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:23.347 INFO:tasks.rados.rados.0.trial114.stdout:88: done (5 left) 2026-02-20T13:05:23.347 INFO:tasks.rados.rados.0.trial114.stdout:89: done (4 left) 2026-02-20T13:05:23.347 INFO:tasks.rados.rados.0.trial114.stdout:90: done (3 left) 2026-02-20T13:05:23.347 INFO:tasks.rados.rados.0.trial114.stdout:92: done (2 left) 2026-02-20T13:05:23.347 INFO:tasks.rados.rados.0.trial114.stdout:93: done (1 left) 2026-02-20T13:05:23.347 INFO:tasks.rados.rados.0.trial114.stdout:94: done (0 left) 2026-02-20T13:05:23.347 INFO:tasks.rados.rados.0.trial114.stdout:95: write oid 42 current snap is 5 2026-02-20T13:05:23.348 INFO:tasks.rados.rados.0.trial114.stdout:95: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2026-02-20T13:05:23.351 INFO:tasks.rados.rados.0.trial114.stdout:95: writing trial11441570-42 from 709262 to 1406520 tid 1 2026-02-20T13:05:23.356 INFO:tasks.rados.rados.0.trial114.stdout:95: writing trial11441570-42 from 2012635 to 2584653 tid 2 2026-02-20T13:05:23.358 INFO:tasks.rados.rados.0.trial114.stdout:95: writing trial11441570-42 from 3046388 to 3109262 tid 3 2026-02-20T13:05:23.359 INFO:tasks.rados.rados.0.trial114.stdout:96: snap_remove snap 0 2026-02-20T13:05:24.347 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [2, 3, 0, 1] 2026-02-20T13:05:24.348 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:05:24.348 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:05:24.352 INFO:tasks.rados.rados.0.trial114.stdout:96: done (1 left) 2026-02-20T13:05:24.352 INFO:tasks.rados.rados.0.trial114.stdout:97: snap_remove snap 4 2026-02-20T13:05:24.435 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:24.428+0000 7f356c85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:24.438 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:24.433+0000 7f356c85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:24.550 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:05:24.550 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:05:24.559 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2026-02-20T13:05:24.348539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":116641204,"num_objects":66,"num_object_clones":12,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":4,"num_read":217,"num_read_kb":49182,"num_write":334,"num_write_kb":68353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":214104,"kb_used_data":214104,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208452520,"statfs":{"total":213674622976,"available":213455380480,"internally_reserved":0,"allocated":219242496,"data_stored":219242496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-991580,"num_objects":3,"num_object_clones":3,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":6,"num_read_kb":2338,"num_write":11,"num_write_kb":2606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.015548"},"pg_stats":[{"pgid":"3.f","version":"30'29","reported_seq":101,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.354576+0000","last_change":"2026-02-20T13:05:22.361528+0000","last_active":"2026-02-20T13:05:22.354576+0000","last_peered":"2026-02-20T13:05:22.354576+0000","last_clean":"2026-02-20T13:05:22.354576+0000","last_became_active":"2026-02-20T13:04:52.984546+0000","last_became_peered":"2026-02-20T13:04:52.984546+0000","last_unstale":"2026-02-20T13:05:22.354576+0000","last_undegraded":"2026-02-20T13:05:22.354576+0000","last_fullsized":"2026-02-20T13:05:22.354576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13831996,"num_objects":8,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":20,"num_read_kb":1762,"num_write":35,"num_write_kb":10272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.356628+0000","last_change":"2026-02-20T13:05:22.361279+0000","last_active":"2026-02-20T13:05:22.356628+0000","last_peered":"2026-02-20T13:05:22.356628+0000","last_clean":"2026-02-20T13:05:22.356628+0000","last_became_active":"2026-02-20T13:05:20.393980+0000","last_became_peered":"2026-02-20T13:05:20.393980+0000","last_unstale":"2026-02-20T13:05:22.356628+0000","last_undegraded":"2026-02-20T13:05:22.356628+0000","last_fullsized":"2026-02-20T13:05:22.356628+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"32'25","reported_seq":89,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.353203+0000","last_change":"2026-02-20T13:05:22.360302+0000","last_active":"2026-02-20T13:05:23.353203+0000","last_peered":"2026-02-20T13:05:23.353203+0000","last_clean":"2026-02-20T13:05:23.353203+0000","last_became_active":"2026-02-20T13:05:20.426009+0000","last_became_peered":"2026-02-20T13:05:20.426009+0000","last_unstale":"2026-02-20T13:05:23.353203+0000","last_undegraded":"2026-02-20T13:05:23.353203+0000","last_fullsized":"2026-02-20T13:05:23.353203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14907611,"num_objects":7,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":1871,"num_write":29,"num_write_kb":7469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"37'30","reported_seq":96,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.351466+0000","last_change":"2026-02-20T13:05:22.361609+0000","last_active":"2026-02-20T13:05:23.351466+0000","last_peered":"2026-02-20T13:05:23.351466+0000","last_clean":"2026-02-20T13:05:23.351466+0000","last_became_active":"2026-02-20T13:05:20.390284+0000","last_became_peered":"2026-02-20T13:05:20.390284+0000","last_unstale":"2026-02-20T13:05:23.351466+0000","last_undegraded":"2026-02-20T13:05:23.351466+0000","last_fullsized":"2026-02-20T13:05:23.351466+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15932838,"num_objects":9,"num_object_clones":2,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":19,"num_read_kb":5309,"num_write":34,"num_write_kb":9782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"32'11","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.355395+0000","last_change":"2026-02-20T13:05:22.363002+0000","last_active":"2026-02-20T13:05:22.355395+0000","last_peered":"2026-02-20T13:05:22.355395+0000","last_clean":"2026-02-20T13:05:22.355395+0000","last_became_active":"2026-02-20T13:05:20.410622+0000","last_became_peered":"2026-02-20T13:05:20.410622+0000","last_unstale":"2026-02-20T13:05:22.355395+0000","last_undegraded":"2026-02-20T13:05:22.355395+0000","last_fullsized":"2026-02-20T13:05:22.355395+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4756315,"num_objects":4,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":11,"num_read_kb":3785,"num_write":13,"num_write_kb":3361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'9","reported_seq":103,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.353048+0000","last_change":"2026-02-20T13:05:22.361538+0000","last_active":"2026-02-20T13:05:23.353048+0000","last_peered":"2026-02-20T13:05:23.353048+0000","last_clean":"2026-02-20T13:05:23.353048+0000","last_became_active":"2026-02-20T13:05:20.409080+0000","last_became_peered":"2026-02-20T13:05:20.409080+0000","last_unstale":"2026-02-20T13:05:23.353048+0000","last_undegraded":"2026-02-20T13:05:23.353048+0000","last_fullsized":"2026-02-20T13:05:23.353048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7495823,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14409,"num_write":12,"num_write_kb":3547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"39'32","reported_seq":127,"reported_epoch":40,"state":"active+clean+snaptrim","last_fresh":"2026-02-20T13:05:23.351715+0000","last_change":"2026-02-20T13:05:22.356654+0000","last_active":"2026-02-20T13:05:23.351715+0000","last_peered":"2026-02-20T13:05:23.351715+0000","last_clean":"2026-02-20T13:05:23.351715+0000","last_became_active":"2026-02-20T13:05:20.415531+0000","last_became_peered":"2026-02-20T13:05:20.415531+0000","last_unstale":"2026-02-20T13:05:23.351715+0000","last_undegraded":"2026-02-20T13:05:23.351715+0000","last_fullsized":"2026-02-20T13:05:23.351715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12470629,"num_objects":9,"num_object_clones":3,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":29,"num_read_kb":14496,"num_write":33,"num_write_kb":9113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"29'3","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.350928+0000","last_change":"2026-02-20T13:05:22.360625+0000","last_active":"2026-02-20T13:05:23.350928+0000","last_peered":"2026-02-20T13:05:23.350928+0000","last_clean":"2026-02-20T13:05:23.350928+0000","last_became_active":"2026-02-20T13:05:20.396688+0000","last_became_peered":"2026-02-20T13:05:20.396688+0000","last_unstale":"2026-02-20T13:05:23.350928+0000","last_undegraded":"2026-02-20T13:05:23.350928+0000","last_fullsized":"2026-02-20T13:05:23.350928+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2252105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3969,"num_write":4,"num_write_kb":878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.354815+0000","last_change":"2026-02-20T13:05:21.363807+0000","last_active":"2026-02-20T13:05:22.354815+0000","last_peered":"2026-02-20T13:05:22.354815+0000","last_clean":"2026-02-20T13:05:22.354815+0000","last_became_active":"2026-02-20T13:05:20.399421+0000","last_became_peered":"2026-02-20T13:05:20.399421+0000","last_unstale":"2026-02-20T13:05:22.354815+0000","last_undegraded":"2026-02-20T13:05:22.354815+0000","last_fullsized":"2026-02-20T13:05:22.354815+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"40'12","reported_seq":104,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.364705+0000","last_change":"2026-02-20T13:05:22.361288+0000","last_active":"2026-02-20T13:05:23.364705+0000","last_peered":"2026-02-20T13:05:23.364705+0000","last_clean":"2026-02-20T13:05:23.364705+0000","last_became_active":"2026-02-20T13:05:20.435618+0000","last_became_peered":"2026-02-20T13:05:20.435618+0000","last_unstale":"2026-02-20T13:05:23.364705+0000","last_undegraded":"2026-02-20T13:05:23.364705+0000","last_fullsized":"2026-02-20T13:05:23.364705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5647086,"num_objects":3,"num_object_clones":1,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":3600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.351831+0000","last_change":"2026-02-20T13:04:53.940535+0000","last_active":"2026-02-20T13:05:23.351831+0000","last_peered":"2026-02-20T13:05:23.351831+0000","last_clean":"2026-02-20T13:05:23.351831+0000","last_became_active":"2026-02-20T13:04:52.954762+0000","last_became_peered":"2026-02-20T13:04:52.954762+0000","last_unstale":"2026-02-20T13:05:23.351831+0000","last_undegraded":"2026-02-20T13:05:23.351831+0000","last_fullsized":"2026-02-20T13:05:23.351831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'25","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-20T13:05:20.427175+0000","last_change":"2026-02-20T13:05:20.428141+0000","last_active":"2026-02-20T13:05:20.427175+0000","last_peered":"2026-02-20T13:05:20.427175+0000","last_clean":"2026-02-20T13:05:17.333550+0000","last_became_active":"2026-02-20T13:05:20.408559+0000","last_became_peered":"2026-02-20T13:05:20.408559+0000","last_unstale":"2026-02-20T13:05:20.427175+0000","last_undegraded":"2026-02-20T13:05:20.427175+0000","last_fullsized":"2026-02-20T13:05:20.427175+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10588278,"num_objects":6,"num_object_clones":2,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6,"num_write":27,"num_write_kb":6614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-20T13:05:20.403854+0000","last_change":"2026-02-20T13:05:20.404445+0000","last_active":"2026-02-20T13:05:20.403854+0000","last_peered":"2026-02-20T13:05:20.403854+0000","last_clean":"2026-02-20T13:05:17.333690+0000","last_became_active":"2026-02-20T13:05:20.394335+0000","last_became_peered":"2026-02-20T13:05:20.394335+0000","last_unstale":"2026-02-20T13:05:20.403854+0000","last_undegraded":"2026-02-20T13:05:20.403854+0000","last_fullsized":"2026-02-20T13:05:20.403854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"29'6","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.372353+0000","last_change":"2026-02-20T13:05:22.358570+0000","last_active":"2026-02-20T13:05:22.372353+0000","last_peered":"2026-02-20T13:05:22.372353+0000","last_clean":"2026-02-20T13:05:22.372353+0000","last_became_active":"2026-02-20T13:05:20.405000+0000","last_became_peered":"2026-02-20T13:05:20.405000+0000","last_unstale":"2026-02-20T13:05:22.372353+0000","last_undegraded":"2026-02-20T13:05:22.372353+0000","last_fullsized":"2026-02-20T13:05:22.372353+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4991613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1091,"num_write":8,"num_write_kb":2066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.354277+0000","last_change":"2026-02-20T13:05:21.357027+0000","last_active":"2026-02-20T13:05:22.354277+0000","last_peered":"2026-02-20T13:05:22.354277+0000","last_clean":"2026-02-20T13:05:22.354277+0000","last_became_active":"2026-02-20T13:05:20.406476+0000","last_became_peered":"2026-02-20T13:05:20.406476+0000","last_unstale":"2026-02-20T13:05:22.354277+0000","last_undegraded":"2026-02-20T13:05:22.354277+0000","last_fullsized":"2026-02-20T13:05:22.354277+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":159,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.352588+0000","last_change":"2026-02-20T13:05:20.431660+0000","last_active":"2026-02-20T13:05:23.352588+0000","last_peered":"2026-02-20T13:05:23.352588+0000","last_clean":"2026-02-20T13:05:23.352588+0000","last_became_active":"2026-02-20T13:05:20.419867+0000","last_became_peered":"2026-02-20T13:05:20.419867+0000","last_unstale":"2026-02-20T13:05:23.352588+0000","last_undegraded":"2026-02-20T13:05:23.352588+0000","last_fullsized":"2026-02-20T13:05:23.352588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'6","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-20T13:05:20.346293+0000","last_change":"2026-02-20T13:05:06.965498+0000","last_active":"2026-02-20T13:05:20.346293+0000","last_peered":"2026-02-20T13:05:20.346293+0000","last_clean":"2026-02-20T13:05:20.346293+0000","last_became_active":"2026-02-20T13:04:52.964654+0000","last_became_peered":"2026-02-20T13:04:52.964654+0000","last_unstale":"2026-02-20T13:05:20.346293+0000","last_undegraded":"2026-02-20T13:05:20.346293+0000","last_fullsized":"2026-02-20T13:05:20.346293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4386561,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2428,"num_write":8,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"29'9","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-20T13:05:20.409218+0000","last_change":"2026-02-20T13:05:20.409826+0000","last_active":"2026-02-20T13:05:20.409218+0000","last_peered":"2026-02-20T13:05:20.409218+0000","last_clean":"2026-02-20T13:05:17.334680+0000","last_became_active":"2026-02-20T13:05:20.397435+0000","last_became_peered":"2026-02-20T13:05:20.397435+0000","last_unstale":"2026-02-20T13:05:20.409218+0000","last_undegraded":"2026-02-20T13:05:20.409218+0000","last_fullsized":"2026-02-20T13:05:20.409218+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4974806,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":2695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":93,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.353710+0000","last_change":"2026-02-20T13:04:53.938992+0000","last_active":"2026-02-20T13:05:23.353710+0000","last_peered":"2026-02-20T13:05:23.353710+0000","last_clean":"2026-02-20T13:05:23.353710+0000","last_became_active":"2026-02-20T13:04:52.958645+0000","last_became_peered":"2026-02-20T13:04:52.958645+0000","last_unstale":"2026-02-20T13:05:23.353710+0000","last_undegraded":"2026-02-20T13:05:23.353710+0000","last_fullsized":"2026-02-20T13:05:23.353710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'6","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.355195+0000","last_change":"2026-02-20T13:05:22.361519+0000","last_active":"2026-02-20T13:05:22.355195+0000","last_peered":"2026-02-20T13:05:22.355195+0000","last_clean":"2026-02-20T13:05:22.355195+0000","last_became_active":"2026-02-20T13:05:20.413766+0000","last_became_peered":"2026-02-20T13:05:20.413766+0000","last_unstale":"2026-02-20T13:05:22.355195+0000","last_undegraded":"2026-02-20T13:05:22.355195+0000","last_fullsized":"2026-02-20T13:05:22.355195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4285719,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":8,"num_write_kb":1909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.356547+0000","last_change":"2026-02-20T13:05:21.360746+0000","last_active":"2026-02-20T13:05:22.356547+0000","last_peered":"2026-02-20T13:05:22.356547+0000","last_clean":"2026-02-20T13:05:22.356547+0000","last_became_active":"2026-02-20T13:05:20.402216+0000","last_became_peered":"2026-02-20T13:05:20.402216+0000","last_unstale":"2026-02-20T13:05:22.356547+0000","last_undegraded":"2026-02-20T13:05:22.356547+0000","last_fullsized":"2026-02-20T13:05:22.356547+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.352953+0000","last_change":"2026-02-20T13:05:22.361877+0000","last_active":"2026-02-20T13:05:22.352953+0000","last_peered":"2026-02-20T13:05:22.352953+0000","last_clean":"2026-02-20T13:05:22.352953+0000","last_became_active":"2026-02-20T13:05:20.404558+0000","last_became_peered":"2026-02-20T13:05:20.404558+0000","last_unstale":"2026-02-20T13:05:22.352953+0000","last_undegraded":"2026-02-20T13:05:22.352953+0000","last_fullsized":"2026-02-20T13:05:22.352953+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6722701,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.352795+0000","last_change":"2026-02-20T13:05:21.358199+0000","last_active":"2026-02-20T13:05:23.352795+0000","last_peered":"2026-02-20T13:05:23.352795+0000","last_clean":"2026-02-20T13:05:23.352795+0000","last_became_active":"2026-02-20T13:05:20.445527+0000","last_became_peered":"2026-02-20T13:05:20.445527+0000","last_unstale":"2026-02-20T13:05:23.352795+0000","last_undegraded":"2026-02-20T13:05:23.352795+0000","last_fullsized":"2026-02-20T13:05:23.352795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"29'3","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2026-02-20T13:05:22.356522+0000","last_change":"2026-02-20T13:05:22.359193+0000","last_active":"2026-02-20T13:05:22.356522+0000","last_peered":"2026-02-20T13:05:22.356522+0000","last_clean":"2026-02-20T13:05:22.356522+0000","last_became_active":"2026-02-20T13:04:52.971451+0000","last_became_peered":"2026-02-20T13:04:52.971451+0000","last_unstale":"2026-02-20T13:05:22.356522+0000","last_undegraded":"2026-02-20T13:05:22.356522+0000","last_fullsized":"2026-02-20T13:05:22.356522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2806736,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":95,"reported_epoch":40,"state":"active+clean","last_fresh":"2026-02-20T13:05:23.351623+0000","last_change":"2026-02-20T13:05:21.357127+0000","last_active":"2026-02-20T13:05:23.351623+0000","last_peered":"2026-02-20T13:05:23.351623+0000","last_clean":"2026-02-20T13:05:23.351623+0000","last_became_active":"2026-02-20T13:05:20.402480+0000","last_became_peered":"2026-02-20T13:05:20.402480+0000","last_unstale":"2026-02-20T13:05:23.351623+0000","last_undegraded":"2026-02-20T13:05:23.351623+0000","last_fullsized":"2026-02-20T13:05:23.351623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":116050817,"num_objects":62,"num_object_clones":12,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":4,"num_read":164,"num_read_kb":49136,"num_write":253,"num_write_kb":67245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213453926400,"internally_reserved":0,"allocated":220696576,"data_stored":220696576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53356208128,"internally_reserved":0,"allocated":62447616,"data_stored":62447616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213488996352,"internally_reserved":0,"allocated":185626624,"data_stored":185626624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":59660,"kb_used_data":59660,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52106996,"statfs":{"total":53418655744,"available":53357563904,"internally_reserved":0,"allocated":61091840,"data_stored":61091840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673024,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":42888,"kb_used_data":42888,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52123768,"statfs":{"total":53418655744,"available":53374738432,"internally_reserved":0,"allocated":43917312,"data_stored":43917312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":36,"seq":154618822660,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":57372,"kb_used_data":57372,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52109284,"statfs":{"total":53418655744,"available":53359906816,"internally_reserved":0,"allocated":58748928,"data_stored":58748928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247836,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":54184,"kb_used_data":54184,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52112472,"statfs":{"total":53418655744,"available":53363171328,"internally_reserved":0,"allocated":55484416,"data_stored":55484416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53363097600,"internally_reserved":0,"allocated":55558144,"data_stored":55558144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53359906816,"internally_reserved":0,"allocated":58748928,"data_stored":58748928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53409783808,"internally_reserved":0,"allocated":8871936,"data_stored":8871936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53356208128,"internally_reserved":0,"allocated":62447616,"data_stored":62447616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53356208128,"internally_reserved":0,"allocated":62447616,"data_stored":62447616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53418655744,"available":53363097600,"internally_reserved":0,"allocated":55558144,"data_stored":55558144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53418655744,"available":53359906816,"internally_reserved":0,"allocated":58748928,"data_stored":58748928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53418655744,"available":53374713856,"internally_reserved":0,"allocated":43941888,"data_stored":43941888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53418655744,"available":53356208128,"internally_reserved":0,"allocated":62447616,"data_stored":62447616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:05:24.710 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:05:24.787 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:24.782+0000 7f0b4be1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:24.789 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:24.785+0000 7f0b4be1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:25.354 INFO:tasks.rados.rados.0.trial114.stdout:97: done (1 left) 2026-02-20T13:05:25.354 INFO:tasks.rados.rados.0.trial114.stdout:98: write (excl) oid 41 current snap is 5 2026-02-20T13:05:25.354 INFO:tasks.rados.rados.0.trial114.stdout:95: finishing write tid 1 to trial11441570-42 2026-02-20T13:05:25.354 INFO:tasks.rados.rados.0.trial114.stdout:98: seq_num 67 ranges {726069=772507,2071117=715676} 2026-02-20T13:05:25.359 INFO:tasks.rados.rados.0.trial114.stdout:98: writing trial11441570-41 from 726069 to 1498576 tid 1 2026-02-20T13:05:25.364 INFO:tasks.rados.rados.0.trial114.stdout:98: writing trial11441570-41 from 2071117 to 2786793 tid 2 2026-02-20T13:05:25.364 INFO:tasks.rados.rados.0.trial114.stdout:99: snap_remove snap 2 2026-02-20T13:05:26.359 INFO:tasks.rados.rados.0.trial114.stdout:99: done (2 left) 2026-02-20T13:05:26.360 INFO:tasks.rados.rados.0.trial114.stdout:100: read oid 34 snap -1 2026-02-20T13:05:26.360 INFO:tasks.rados.rados.0.trial114.stdout:100: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-20T13:05:26.360 INFO:tasks.rados.rados.0.trial114.stdout:101: delete oid 44 current snap is 5 2026-02-20T13:05:26.360 INFO:tasks.rados.rados.0.trial114.stdout:95: finishing write tid 2 to trial11441570-42 2026-02-20T13:05:26.360 INFO:tasks.rados.rados.0.trial114.stdout:95: finishing write tid 3 to trial11441570-42 2026-02-20T13:05:26.360 INFO:tasks.rados.rados.0.trial114.stdout:95: finishing write tid 4 to trial11441570-42 2026-02-20T13:05:26.360 INFO:tasks.rados.rados.0.trial114.stdout:95: finishing write tid 5 to trial11441570-42 2026-02-20T13:05:26.360 INFO:tasks.rados.rados.0.trial114.stdout:95: oid 42 updating version 0 to 12 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:95: oid 42 version 12 is already newer than 12 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:95: oid 42 version 12 is already newer than 12 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:95: oid 42 version 12 is already newer than 12 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 42 v 12 (ObjNum 66 snap 5 seq_num 66) dirty exists 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:95: left oid 42 (ObjNum 66 snap 5 seq_num 66) 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:98: finishing write tid 1 to trial11441570-41 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:98: finishing write tid 2 to trial11441570-41 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:98: finishing write tid 3 to trial11441570-41 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:98: finishing write tid 4 to trial11441570-41 2026-02-20T13:05:26.361 INFO:tasks.rados.rados.0.trial114.stdout:98: oid 41 updating version 0 to 35 2026-02-20T13:05:26.362 INFO:tasks.rados.rados.0.trial114.stdout:98: oid 41 updating version 35 to 37 2026-02-20T13:05:26.362 INFO:tasks.rados.rados.0.trial114.stdout:98: oid 41 version 37 is already newer than 37 2026-02-20T13:05:26.362 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 41 v 37 (ObjNum 67 snap 5 seq_num 67) dirty exists 2026-02-20T13:05:26.362 INFO:tasks.rados.rados.0.trial114.stdout:98: left oid 41 (ObjNum 67 snap 5 seq_num 67) 2026-02-20T13:05:26.385 INFO:tasks.rados.rados.0.trial114.stdout:95: done (3 left) 2026-02-20T13:05:26.385 INFO:tasks.rados.rados.0.trial114.stdout:98: done (2 left) 2026-02-20T13:05:26.385 INFO:tasks.rados.rados.0.trial114.stdout:101: done (1 left) 2026-02-20T13:05:26.385 INFO:tasks.rados.rados.0.trial114.stdout:102: snap_create 2026-02-20T13:05:26.388 INFO:tasks.rados.rados.0.trial114.stdout:100: expect (ObjNum 33 snap 0 seq_num 33) 2026-02-20T13:05:26.408 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2103653 2026-02-20T13:05:26.411 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:26.849 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:05:26.929 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:26.924+0000 7ff87c011640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:26.932 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:26.928+0000 7ff87c011640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:27.362 INFO:tasks.rados.rados.0.trial114.stdout:100: done (1 left) 2026-02-20T13:05:27.362 INFO:tasks.rados.rados.0.trial114.stdout:102: done (0 left) 2026-02-20T13:05:27.362 INFO:tasks.rados.rados.0.trial114.stdout:103: snap_create 2026-02-20T13:05:28.364 INFO:tasks.rados.rados.0.trial114.stdout:103: done (0 left) 2026-02-20T13:05:28.364 INFO:tasks.rados.rados.0.trial114.stdout:104: snap_create 2026-02-20T13:05:28.992 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:05:29.070 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:29.065+0000 7f191ac5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:29.072 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:29.068+0000 7f191ac5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:29.365 INFO:tasks.rados.rados.0.trial114.stdout:104: done (0 left) 2026-02-20T13:05:29.365 INFO:tasks.rados.rados.0.trial114.stdout:105: snap_remove snap 7 2026-02-20T13:05:29.561 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [2, 3, 0, 1] 2026-02-20T13:05:29.561 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:05:29.561 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:05:29.641 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:29.635+0000 7f42996cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:29.644 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:29.640+0000 7f42996cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:29.757 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:05:29.757 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:05:29.767 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2026-02-20T13:05:29.579596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":91717800,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":56969,"num_write":339,"num_write_kb":69807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":196808,"kb_used_data":196808,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208469816,"statfs":{"total":213674622976,"available":213473091584,"internally_reserved":0,"allocated":201531392,"data_stored":201531392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24923404,"num_objects":-17,"num_object_clones":-12,"num_object_copies":-51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":-4,"num_read":10,"num_read_kb":7787,"num_write":5,"num_write_kb":1454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000888"},"pg_stats":[{"pgid":"3.f","version":"43'39","reported_seq":121,"reported_epoch":44,"state":"active+clean+snaptrim","last_fresh":"2026-02-20T13:05:27.365985+0000","last_change":"2026-02-20T13:05:24.360501+0000","last_active":"2026-02-20T13:05:27.365985+0000","last_peered":"2026-02-20T13:05:27.365985+0000","last_clean":"2026-02-20T13:05:27.365985+0000","last_became_active":"2026-02-20T13:04:52.984546+0000","last_became_peered":"2026-02-20T13:04:52.984546+0000","last_unstale":"2026-02-20T13:05:27.365985+0000","last_undegraded":"2026-02-20T13:05:27.365985+0000","last_fullsized":"2026-02-20T13:05:27.365985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0,"stat_sum":{"num_bytes":9262335,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":1763,"num_write":39,"num_write_kb":11726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":43,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-20T13:05:27.368380+0000","last_change":"2026-02-20T13:05:26.372067+0000","last_active":"2026-02-20T13:05:27.368380+0000","last_peered":"2026-02-20T13:05:27.368380+0000","last_clean":"2026-02-20T13:05:27.368380+0000","last_became_active":"2026-02-20T13:05:20.393980+0000","last_became_peered":"2026-02-20T13:05:20.393980+0000","last_unstale":"2026-02-20T13:05:27.368380+0000","last_undegraded":"2026-02-20T13:05:27.368380+0000","last_fullsized":"2026-02-20T13:05:27.368380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"41'27","reported_seq":106,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.374922+0000","last_change":"2026-02-20T13:05:26.427369+0000","last_active":"2026-02-20T13:05:28.374922+0000","last_peered":"2026-02-20T13:05:28.374922+0000","last_clean":"2026-02-20T13:05:28.374922+0000","last_became_active":"2026-02-20T13:05:20.426009+0000","last_became_peered":"2026-02-20T13:05:20.426009+0000","last_unstale":"2026-02-20T13:05:28.374922+0000","last_undegraded":"2026-02-20T13:05:28.374922+0000","last_fullsized":"2026-02-20T13:05:28.374922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0,"stat_sum":{"num_bytes":13782363,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":1871,"num_write":29,"num_write_kb":7469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"43'37","reported_seq":114,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.446865+0000","last_change":"2026-02-20T13:05:28.450259+0000","last_active":"2026-02-20T13:05:28.446865+0000","last_peered":"2026-02-20T13:05:28.446865+0000","last_clean":"2026-02-20T13:05:28.446865+0000","last_became_active":"2026-02-20T13:05:20.390284+0000","last_became_peered":"2026-02-20T13:05:20.390284+0000","last_unstale":"2026-02-20T13:05:28.446865+0000","last_undegraded":"2026-02-20T13:05:28.446865+0000","last_fullsized":"2026-02-20T13:05:28.446865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0,"stat_sum":{"num_bytes":9742330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":5309,"num_write":35,"num_write_kb":9782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"41'13","reported_seq":68,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-20T13:05:27.367231+0000","last_change":"2026-02-20T13:05:26.412525+0000","last_active":"2026-02-20T13:05:27.367231+0000","last_peered":"2026-02-20T13:05:27.367231+0000","last_clean":"2026-02-20T13:05:27.367231+0000","last_became_active":"2026-02-20T13:05:20.410622+0000","last_became_peered":"2026-02-20T13:05:20.410622+0000","last_unstale":"2026-02-20T13:05:27.367231+0000","last_undegraded":"2026-02-20T13:05:27.367231+0000","last_fullsized":"2026-02-20T13:05:27.367231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0,"stat_sum":{"num_bytes":2554631,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3785,"num_write":13,"num_write_kb":3361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'9","reported_seq":121,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.375837+0000","last_change":"2026-02-20T13:05:26.372326+0000","last_active":"2026-02-20T13:05:28.375837+0000","last_peered":"2026-02-20T13:05:28.375837+0000","last_clean":"2026-02-20T13:05:28.375837+0000","last_became_active":"2026-02-20T13:05:20.409080+0000","last_became_peered":"2026-02-20T13:05:20.409080+0000","last_unstale":"2026-02-20T13:05:28.375837+0000","last_undegraded":"2026-02-20T13:05:28.375837+0000","last_fullsized":"2026-02-20T13:05:28.375837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7495823,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14409,"num_write":12,"num_write_kb":3547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"43'38","reported_seq":143,"reported_epoch":45,"state":"active+clean+snaptrim","last_fresh":"2026-02-20T13:05:28.481691+0000","last_change":"2026-02-20T13:05:22.356654+0000","last_active":"2026-02-20T13:05:28.481691+0000","last_peered":"2026-02-20T13:05:28.481691+0000","last_clean":"2026-02-20T13:05:28.481691+0000","last_became_active":"2026-02-20T13:05:20.415531+0000","last_became_peered":"2026-02-20T13:05:20.415531+0000","last_unstale":"2026-02-20T13:05:28.481691+0000","last_undegraded":"2026-02-20T13:05:28.481691+0000","last_fullsized":"2026-02-20T13:05:28.481691+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0,"stat_sum":{"num_bytes":7645710,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":14496,"num_write":33,"num_write_kb":9113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"29'3","reported_seq":83,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.373502+0000","last_change":"2026-02-20T13:05:26.371607+0000","last_active":"2026-02-20T13:05:28.373502+0000","last_peered":"2026-02-20T13:05:28.373502+0000","last_clean":"2026-02-20T13:05:28.373502+0000","last_became_active":"2026-02-20T13:05:20.396688+0000","last_became_peered":"2026-02-20T13:05:20.396688+0000","last_unstale":"2026-02-20T13:05:28.373502+0000","last_undegraded":"2026-02-20T13:05:28.373502+0000","last_fullsized":"2026-02-20T13:05:28.373502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2252105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3969,"num_write":4,"num_write_kb":878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-20T13:05:27.367524+0000","last_change":"2026-02-20T13:05:21.363807+0000","last_active":"2026-02-20T13:05:27.367524+0000","last_peered":"2026-02-20T13:05:27.367524+0000","last_clean":"2026-02-20T13:05:27.367524+0000","last_became_active":"2026-02-20T13:05:20.399421+0000","last_became_peered":"2026-02-20T13:05:20.399421+0000","last_unstale":"2026-02-20T13:05:27.367524+0000","last_undegraded":"2026-02-20T13:05:27.367524+0000","last_fullsized":"2026-02-20T13:05:27.367524+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'16","reported_seq":120,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.411802+0000","last_change":"2026-02-20T13:05:28.413897+0000","last_active":"2026-02-20T13:05:28.411802+0000","last_peered":"2026-02-20T13:05:28.411802+0000","last_clean":"2026-02-20T13:05:28.411802+0000","last_became_active":"2026-02-20T13:05:20.435618+0000","last_became_peered":"2026-02-20T13:05:20.435618+0000","last_unstale":"2026-02-20T13:05:28.411802+0000","last_undegraded":"2026-02-20T13:05:28.411802+0000","last_fullsized":"2026-02-20T13:05:28.411802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0,"stat_sum":{"num_bytes":2957999,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":3600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":108,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.372987+0000","last_change":"2026-02-20T13:04:53.940535+0000","last_active":"2026-02-20T13:05:28.372987+0000","last_peered":"2026-02-20T13:05:28.372987+0000","last_clean":"2026-02-20T13:05:28.372987+0000","last_became_active":"2026-02-20T13:04:52.954762+0000","last_became_peered":"2026-02-20T13:04:52.954762+0000","last_unstale":"2026-02-20T13:05:28.372987+0000","last_undegraded":"2026-02-20T13:05:28.372987+0000","last_fullsized":"2026-02-20T13:05:28.372987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"41'29","reported_seq":85,"reported_epoch":42,"state":"active+clean+snaptrim","last_fresh":"2026-02-20T13:05:25.367660+0000","last_change":"2026-02-20T13:05:24.359392+0000","last_active":"2026-02-20T13:05:25.367660+0000","last_peered":"2026-02-20T13:05:25.367660+0000","last_clean":"2026-02-20T13:05:25.367660+0000","last_became_active":"2026-02-20T13:05:20.408559+0000","last_became_peered":"2026-02-20T13:05:20.408559+0000","last_unstale":"2026-02-20T13:05:25.367660+0000","last_undegraded":"2026-02-20T13:05:25.367660+0000","last_fullsized":"2026-02-20T13:05:25.367660+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":2,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0,"stat_sum":{"num_bytes":7265981,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":6,"num_write":27,"num_write_kb":6614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":74,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-20T13:05:25.369656+0000","last_change":"2026-02-20T13:05:21.354608+0000","last_active":"2026-02-20T13:05:25.369656+0000","last_peered":"2026-02-20T13:05:25.369656+0000","last_clean":"2026-02-20T13:05:25.369656+0000","last_became_active":"2026-02-20T13:05:20.394335+0000","last_became_peered":"2026-02-20T13:05:20.394335+0000","last_unstale":"2026-02-20T13:05:25.369656+0000","last_undegraded":"2026-02-20T13:05:25.369656+0000","last_fullsized":"2026-02-20T13:05:25.369656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"29'6","reported_seq":52,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-20T13:05:27.368834+0000","last_change":"2026-02-20T13:05:26.369841+0000","last_active":"2026-02-20T13:05:27.368834+0000","last_peered":"2026-02-20T13:05:27.368834+0000","last_clean":"2026-02-20T13:05:27.368834+0000","last_became_active":"2026-02-20T13:05:20.405000+0000","last_became_peered":"2026-02-20T13:05:20.405000+0000","last_unstale":"2026-02-20T13:05:27.368834+0000","last_undegraded":"2026-02-20T13:05:27.368834+0000","last_fullsized":"2026-02-20T13:05:27.368834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4991613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1091,"num_write":8,"num_write_kb":2066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":50,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-20T13:05:27.368886+0000","last_change":"2026-02-20T13:05:21.357027+0000","last_active":"2026-02-20T13:05:27.368886+0000","last_peered":"2026-02-20T13:05:27.368886+0000","last_clean":"2026-02-20T13:05:27.368886+0000","last_became_active":"2026-02-20T13:05:20.406476+0000","last_became_peered":"2026-02-20T13:05:20.406476+0000","last_unstale":"2026-02-20T13:05:27.368886+0000","last_undegraded":"2026-02-20T13:05:27.368886+0000","last_fullsized":"2026-02-20T13:05:27.368886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":174,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.375620+0000","last_change":"2026-02-20T13:05:20.431660+0000","last_active":"2026-02-20T13:05:28.375620+0000","last_peered":"2026-02-20T13:05:28.375620+0000","last_clean":"2026-02-20T13:05:28.375620+0000","last_became_active":"2026-02-20T13:05:20.419867+0000","last_became_peered":"2026-02-20T13:05:20.419867+0000","last_unstale":"2026-02-20T13:05:28.375620+0000","last_undegraded":"2026-02-20T13:05:28.375620+0000","last_fullsized":"2026-02-20T13:05:28.375620+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'6","reported_seq":77,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-20T13:05:25.370523+0000","last_change":"2026-02-20T13:05:25.373236+0000","last_active":"2026-02-20T13:05:25.370523+0000","last_peered":"2026-02-20T13:05:25.370523+0000","last_clean":"2026-02-20T13:05:25.370523+0000","last_became_active":"2026-02-20T13:04:52.964654+0000","last_became_peered":"2026-02-20T13:04:52.964654+0000","last_unstale":"2026-02-20T13:05:25.370523+0000","last_undegraded":"2026-02-20T13:05:25.370523+0000","last_fullsized":"2026-02-20T13:05:25.370523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4386561,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2428,"num_write":8,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"29'9","reported_seq":76,"reported_epoch":42,"state":"active+clean","last_fresh":"2026-02-20T13:05:25.370618+0000","last_change":"2026-02-20T13:05:25.373240+0000","last_active":"2026-02-20T13:05:25.370618+0000","last_peered":"2026-02-20T13:05:25.370618+0000","last_clean":"2026-02-20T13:05:25.370618+0000","last_became_active":"2026-02-20T13:05:20.397435+0000","last_became_peered":"2026-02-20T13:05:20.397435+0000","last_unstale":"2026-02-20T13:05:25.370618+0000","last_undegraded":"2026-02-20T13:05:25.370618+0000","last_fullsized":"2026-02-20T13:05:25.370618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4974806,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7789,"num_write":12,"num_write_kb":2695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":108,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.374396+0000","last_change":"2026-02-20T13:04:53.938992+0000","last_active":"2026-02-20T13:05:28.374396+0000","last_peered":"2026-02-20T13:05:28.374396+0000","last_clean":"2026-02-20T13:05:28.374396+0000","last_became_active":"2026-02-20T13:04:52.958645+0000","last_became_peered":"2026-02-20T13:04:52.958645+0000","last_unstale":"2026-02-20T13:05:28.374396+0000","last_undegraded":"2026-02-20T13:05:28.374396+0000","last_fullsized":"2026-02-20T13:05:28.374396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'6","reported_seq":50,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-20T13:05:27.368030+0000","last_change":"2026-02-20T13:05:26.372118+0000","last_active":"2026-02-20T13:05:27.368030+0000","last_peered":"2026-02-20T13:05:27.368030+0000","last_clean":"2026-02-20T13:05:27.368030+0000","last_became_active":"2026-02-20T13:05:20.413766+0000","last_became_peered":"2026-02-20T13:05:20.413766+0000","last_unstale":"2026-02-20T13:05:27.368030+0000","last_undegraded":"2026-02-20T13:05:27.368030+0000","last_fullsized":"2026-02-20T13:05:27.368030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4285719,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":8,"num_write_kb":1909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-20T13:05:27.368473+0000","last_change":"2026-02-20T13:05:21.360746+0000","last_active":"2026-02-20T13:05:27.368473+0000","last_peered":"2026-02-20T13:05:27.368473+0000","last_clean":"2026-02-20T13:05:27.368473+0000","last_became_active":"2026-02-20T13:05:20.402216+0000","last_became_peered":"2026-02-20T13:05:20.402216+0000","last_unstale":"2026-02-20T13:05:27.368473+0000","last_undegraded":"2026-02-20T13:05:27.368473+0000","last_fullsized":"2026-02-20T13:05:27.368473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":54,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-20T13:05:27.367056+0000","last_change":"2026-02-20T13:05:26.369612+0000","last_active":"2026-02-20T13:05:27.367056+0000","last_peered":"2026-02-20T13:05:27.367056+0000","last_clean":"2026-02-20T13:05:27.367056+0000","last_became_active":"2026-02-20T13:05:20.404558+0000","last_became_peered":"2026-02-20T13:05:20.404558+0000","last_unstale":"2026-02-20T13:05:27.367056+0000","last_undegraded":"2026-02-20T13:05:27.367056+0000","last_fullsized":"2026-02-20T13:05:27.367056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6722701,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":100,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.375170+0000","last_change":"2026-02-20T13:05:21.358199+0000","last_active":"2026-02-20T13:05:28.375170+0000","last_peered":"2026-02-20T13:05:28.375170+0000","last_clean":"2026-02-20T13:05:28.375170+0000","last_became_active":"2026-02-20T13:05:20.445527+0000","last_became_peered":"2026-02-20T13:05:20.445527+0000","last_unstale":"2026-02-20T13:05:28.375170+0000","last_undegraded":"2026-02-20T13:05:28.375170+0000","last_fullsized":"2026-02-20T13:05:28.375170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"29'3","reported_seq":85,"reported_epoch":44,"state":"active+clean","last_fresh":"2026-02-20T13:05:27.367955+0000","last_change":"2026-02-20T13:05:26.371088+0000","last_active":"2026-02-20T13:05:27.367955+0000","last_peered":"2026-02-20T13:05:27.367955+0000","last_clean":"2026-02-20T13:05:27.367955+0000","last_became_active":"2026-02-20T13:04:52.971451+0000","last_became_peered":"2026-02-20T13:04:52.971451+0000","last_unstale":"2026-02-20T13:05:27.367955+0000","last_undegraded":"2026-02-20T13:05:27.367955+0000","last_fullsized":"2026-02-20T13:05:27.367955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2806736,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":110,"reported_epoch":45,"state":"active+clean","last_fresh":"2026-02-20T13:05:28.373221+0000","last_change":"2026-02-20T13:05:21.357127+0000","last_active":"2026-02-20T13:05:28.373221+0000","last_peered":"2026-02-20T13:05:28.373221+0000","last_clean":"2026-02-20T13:05:28.373221+0000","last_became_active":"2026-02-20T13:05:20.402480+0000","last_became_peered":"2026-02-20T13:05:20.402480+0000","last_unstale":"2026-02-20T13:05:28.373221+0000","last_undegraded":"2026-02-20T13:05:28.373221+0000","last_fullsized":"2026-02-20T13:05:28.373221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":91127413,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":56923,"num_write":258,"num_write_kb":68699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1261568,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213472833536,"internally_reserved":0,"allocated":201789440,"data_stored":201789440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":250,"ondisk_log_size":250,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53364727808,"internally_reserved":0,"allocated":53927936,"data_stored":53927936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213506027520,"internally_reserved":0,"allocated":168595456,"data_stored":168595456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640325,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":53952,"kb_used_data":53952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52112704,"statfs":{"total":53418655744,"available":53363408896,"internally_reserved":0,"allocated":55246848,"data_stored":55246848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":41072,"kb_used_data":41072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52125584,"statfs":{"total":53418655744,"available":53376598016,"internally_reserved":0,"allocated":42057728,"data_stored":42057728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":36,"seq":154618822665,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":51588,"kb_used_data":51588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52115068,"statfs":{"total":53418655744,"available":53365829632,"internally_reserved":0,"allocated":52826112,"data_stored":52826112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":23,"seq":98784247841,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":50196,"kb_used_data":50196,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52116460,"statfs":{"total":53418655744,"available":53367255040,"internally_reserved":0,"allocated":51400704,"data_stored":51400704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53365686272,"internally_reserved":0,"allocated":52969472,"data_stored":52969472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53365829632,"internally_reserved":0,"allocated":52826112,"data_stored":52826112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53409783808,"internally_reserved":0,"allocated":8871936,"data_stored":8871936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53364727808,"internally_reserved":0,"allocated":53927936,"data_stored":53927936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53364727808,"internally_reserved":0,"allocated":53927936,"data_stored":53927936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53418655744,"available":53365686272,"internally_reserved":0,"allocated":52969472,"data_stored":52969472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53418655744,"available":53365829632,"internally_reserved":0,"allocated":52826112,"data_stored":52826112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53418655744,"available":53376589824,"internally_reserved":0,"allocated":42065920,"data_stored":42065920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53418655744,"available":53364727808,"internally_reserved":0,"allocated":53927936,"data_stored":53927936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:05:30.372 INFO:tasks.rados.rados.0.trial114.stdout:105: done (0 left) 2026-02-20T13:05:30.372 INFO:tasks.rados.rados.0.trial114.stdout:106: read oid 14 snap 6 2026-02-20T13:05:30.372 INFO:tasks.rados.rados.0.trial114.stdout:106: expect (ObjNum 13 snap 0 seq_num 13) 2026-02-20T13:05:30.372 INFO:tasks.rados.rados.0.trial114.stdout:107: snap_remove snap 5 2026-02-20T13:05:31.133 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:05:31.210 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:31.205+0000 7f0837c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:31.212 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:31.209+0000 7f0837c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:31.373 INFO:tasks.rados.rados.0.trial114.stdout:107: done (1 left) 2026-02-20T13:05:31.373 INFO:tasks.rados.rados.0.trial114.stdout:108: write oid 47 current snap is 8 2026-02-20T13:05:31.373 INFO:tasks.rados.rados.0.trial114.stdout:108: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2026-02-20T13:05:31.379 INFO:tasks.rados.rados.0.trial114.stdout:108: writing trial11441570-47 from 759683 to 1399041 tid 1 2026-02-20T13:05:31.384 INFO:tasks.rados.rados.0.trial114.stdout:108: writing trial11441570-47 from 1904434 to 2623779 tid 2 2026-02-20T13:05:31.386 INFO:tasks.rados.rados.0.trial114.stdout:108: writing trial11441570-47 from 3128657 to 3159683 tid 3 2026-02-20T13:05:31.387 INFO:tasks.rados.rados.0.trial114.stdout:109: write (excl) oid 18 current snap is 8 2026-02-20T13:05:31.387 INFO:tasks.rados.rados.0.trial114.stdout:109: seq_num 70 ranges {776490=714607,2246563=579356} 2026-02-20T13:05:31.392 INFO:tasks.rados.rados.0.trial114.stdout:109: writing trial11441570-18 from 776490 to 1491097 tid 1 2026-02-20T13:05:31.397 INFO:tasks.rados.rados.0.trial114.stdout:109: writing trial11441570-18 from 2246563 to 2825919 tid 2 2026-02-20T13:05:31.397 INFO:tasks.rados.rados.0.trial114.stdout:110: write (excl) oid 39 current snap is 8 2026-02-20T13:05:31.397 INFO:tasks.rados.rados.0.trial114.stdout:106: expect (ObjNum 13 snap 0 seq_num 13) 2026-02-20T13:05:31.453 INFO:tasks.rados.rados.0.trial114.stdout:108: finishing write tid 1 to trial11441570-47 2026-02-20T13:05:31.453 INFO:tasks.rados.rados.0.trial114.stdout:108: finishing write tid 2 to trial11441570-47 2026-02-20T13:05:31.453 INFO:tasks.rados.rados.0.trial114.stdout:110: seq_num 71 ranges {793297=789856,2305045=723014} 2026-02-20T13:05:31.458 INFO:tasks.rados.rados.0.trial114.stdout:110: writing trial11441570-39 from 793297 to 1583153 tid 1 2026-02-20T13:05:31.465 INFO:tasks.rados.rados.0.trial114.stdout:110: writing trial11441570-39 from 2305045 to 3028059 tid 2 2026-02-20T13:05:31.465 INFO:tasks.rados.rados.0.trial114.stdout:106: done (3 left) 2026-02-20T13:05:31.465 INFO:tasks.rados.rados.0.trial114.stdout:111: write oid 48 current snap is 8 2026-02-20T13:05:31.465 INFO:tasks.rados.rados.0.trial114.stdout:108: finishing write tid 3 to trial11441570-47 2026-02-20T13:05:31.465 INFO:tasks.rados.rados.0.trial114.stdout:108: finishing write tid 4 to trial11441570-47 2026-02-20T13:05:31.465 INFO:tasks.rados.rados.0.trial114.stdout:108: finishing write tid 5 to trial11441570-47 2026-02-20T13:05:31.465 INFO:tasks.rados.rados.0.trial114.stdout:108: oid 47 updating version 0 to 11 2026-02-20T13:05:31.465 INFO:tasks.rados.rados.0.trial114.stdout:108: oid 47 version 11 is already newer than 11 2026-02-20T13:05:31.465 INFO:tasks.rados.rados.0.trial114.stdout:108: oid 47 version 11 is already newer than 11 2026-02-20T13:05:31.466 INFO:tasks.rados.rados.0.trial114.stdout:108: oid 47 version 11 is already newer than 11 2026-02-20T13:05:31.466 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 47 v 11 (ObjNum 69 snap 8 seq_num 69) dirty exists 2026-02-20T13:05:31.466 INFO:tasks.rados.rados.0.trial114.stdout:108: left oid 47 (ObjNum 69 snap 8 seq_num 69) 2026-02-20T13:05:31.466 INFO:tasks.rados.rados.0.trial114.stdout:109: finishing write tid 1 to trial11441570-18 2026-02-20T13:05:31.466 INFO:tasks.rados.rados.0.trial114.stdout:111: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2026-02-20T13:05:31.467 INFO:tasks.rados.rados.0.trial114.stdout:111: writing trial11441570-48 from 410104 to 875209 tid 1 2026-02-20T13:05:31.472 INFO:tasks.rados.rados.0.trial114.stdout:111: writing trial11441570-48 from 1563527 to 2146552 tid 2 2026-02-20T13:05:31.476 INFO:tasks.rados.rados.0.trial114.stdout:111: writing trial11441570-48 from 2810926 to 3210104 tid 3 2026-02-20T13:05:31.476 INFO:tasks.rados.rados.0.trial114.stdout:108: done (3 left) 2026-02-20T13:05:31.477 INFO:tasks.rados.rados.0.trial114.stdout:112: write oid 45 current snap is 8 2026-02-20T13:05:31.477 INFO:tasks.rados.rados.0.trial114.stdout:112: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2026-02-20T13:05:31.480 INFO:tasks.rados.rados.0.trial114.stdout:112: writing trial11441570-45 from 426911 to 967265 tid 1 2026-02-20T13:05:31.485 INFO:tasks.rados.rados.0.trial114.stdout:112: writing trial11441570-45 from 1622009 to 2348692 tid 2 2026-02-20T13:05:31.488 INFO:tasks.rados.rados.0.trial114.stdout:112: writing trial11441570-45 from 3121996 to 3226911 tid 3 2026-02-20T13:05:31.488 INFO:tasks.rados.rados.0.trial114.stdout:113: write oid 17 current snap is 8 2026-02-20T13:05:31.489 INFO:tasks.rados.rados.0.trial114.stdout:113: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2026-02-20T13:05:31.492 INFO:tasks.rados.rados.0.trial114.stdout:113: writing trial11441570-17 from 443718 to 1059321 tid 1 2026-02-20T13:05:31.496 INFO:tasks.rados.rados.0.trial114.stdout:113: writing trial11441570-17 from 1564138 to 2034479 tid 2 2026-02-20T13:05:31.502 INFO:tasks.rados.rados.0.trial114.stdout:113: writing trial11441570-17 from 2633066 to 3243718 tid 3 2026-02-20T13:05:31.502 INFO:tasks.rados.rados.0.trial114.stdout:114: read oid 49 snap -1 2026-02-20T13:05:31.502 INFO:tasks.rados.rados.0.trial114.stdout:114: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-20T13:05:31.502 INFO:tasks.rados.rados.0.trial114.stdout:115: delete oid 32 current snap is 8 2026-02-20T13:05:31.503 INFO:tasks.rados.rados.0.trial114.stdout:109: finishing write tid 2 to trial11441570-18 2026-02-20T13:05:31.503 INFO:tasks.rados.rados.0.trial114.stdout:109: finishing write tid 3 to trial11441570-18 2026-02-20T13:05:31.503 INFO:tasks.rados.rados.0.trial114.stdout:110: finishing write tid 1 to trial11441570-39 2026-02-20T13:05:31.503 INFO:tasks.rados.rados.0.trial114.stdout:109: finishing write tid 4 to trial11441570-18 2026-02-20T13:05:31.503 INFO:tasks.rados.rados.0.trial114.stdout:109: oid 18 updating version 0 to 13 2026-02-20T13:05:31.503 INFO:tasks.rados.rados.0.trial114.stdout:109: oid 18 version 13 is already newer than 11 2026-02-20T13:05:31.503 INFO:tasks.rados.rados.0.trial114.stdout:109: oid 18 version 13 is already newer than 13 2026-02-20T13:05:31.504 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 18 v 13 (ObjNum 70 snap 8 seq_num 70) dirty exists 2026-02-20T13:05:31.504 INFO:tasks.rados.rados.0.trial114.stdout:109: left oid 18 (ObjNum 70 snap 8 seq_num 70) 2026-02-20T13:05:31.504 INFO:tasks.rados.rados.0.trial114.stdout:111: finishing write tid 1 to trial11441570-48 2026-02-20T13:05:31.515 INFO:tasks.rados.rados.0.trial114.stdout:111: finishing write tid 2 to trial11441570-48 2026-02-20T13:05:31.516 INFO:tasks.rados.rados.0.trial114.stdout:110: finishing write tid 2 to trial11441570-39 2026-02-20T13:05:31.516 INFO:tasks.rados.rados.0.trial114.stdout:114: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-20T13:05:31.524 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2115054 2026-02-20T13:05:31.568 INFO:tasks.rados.rados.0.trial114.stdout:109: done (6 left) 2026-02-20T13:05:31.568 INFO:tasks.rados.rados.0.trial114.stdout:114: done (5 left) 2026-02-20T13:05:31.569 INFO:tasks.rados.rados.0.trial114.stdout:115: done (4 left) 2026-02-20T13:05:31.569 INFO:tasks.rados.rados.0.trial114.stdout:116: snap_remove snap 6 2026-02-20T13:05:32.378 INFO:tasks.rados.rados.0.trial114.stdout:116: done (4 left) 2026-02-20T13:05:32.378 INFO:tasks.rados.rados.0.trial114.stdout:117: read oid 19 snap -1 2026-02-20T13:05:32.378 INFO:tasks.rados.rados.0.trial114.stdout:117: expect deleted 2026-02-20T13:05:32.378 INFO:tasks.rados.rados.0.trial114.stdout:118: write oid 37 current snap is 8 2026-02-20T13:05:32.378 INFO:tasks.rados.rados.0.trial114.stdout:111: finishing write tid 3 to trial11441570-48 2026-02-20T13:05:32.379 INFO:tasks.rados.rados.0.trial114.stdout:118: seq_num 76 ranges {477332=766101,1681102=474010,2687912=589420} 2026-02-20T13:05:32.382 INFO:tasks.rados.rados.0.trial114.stdout:118: writing trial11441570-37 from 477332 to 1243433 tid 1 2026-02-20T13:05:32.386 INFO:tasks.rados.rados.0.trial114.stdout:118: writing trial11441570-37 from 1681102 to 2155112 tid 2 2026-02-20T13:05:32.391 INFO:tasks.rados.rados.0.trial114.stdout:118: writing trial11441570-37 from 2687912 to 3277332 tid 3 2026-02-20T13:05:32.391 INFO:tasks.rados.rados.0.trial114.stdout:119: snap_create 2026-02-20T13:05:32.391 INFO:tasks.rados.rados.0.trial114.stdout:110: finishing write tid 3 to trial11441570-39 2026-02-20T13:05:32.391 INFO:tasks.rados.rados.0.trial114.stdout:111: finishing write tid 4 to trial11441570-48 2026-02-20T13:05:32.391 INFO:tasks.rados.rados.0.trial114.stdout:111: finishing write tid 5 to trial11441570-48 2026-02-20T13:05:32.391 INFO:tasks.rados.rados.0.trial114.stdout:111: oid 48 updating version 0 to 18 2026-02-20T13:05:32.391 INFO:tasks.rados.rados.0.trial114.stdout:111: oid 48 version 18 is already newer than 18 2026-02-20T13:05:32.391 INFO:tasks.rados.rados.0.trial114.stdout:111: oid 48 version 18 is already newer than 18 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:111: oid 48 version 18 is already newer than 18 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 48 v 18 (ObjNum 72 snap 8 seq_num 72) dirty exists 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:111: left oid 48 (ObjNum 72 snap 8 seq_num 72) 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:110: finishing write tid 4 to trial11441570-39 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:110: oid 39 updating version 0 to 29 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:110: oid 39 updating version 29 to 31 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:110: oid 39 version 31 is already newer than 31 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 39 v 31 (ObjNum 71 snap 8 seq_num 71) dirty exists 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:110: left oid 39 (ObjNum 71 snap 8 seq_num 71) 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:113: finishing write tid 1 to trial11441570-17 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:113: finishing write tid 2 to trial11441570-17 2026-02-20T13:05:32.392 INFO:tasks.rados.rados.0.trial114.stdout:113: finishing write tid 3 to trial11441570-17 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:113: finishing write tid 4 to trial11441570-17 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:113: finishing write tid 5 to trial11441570-17 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:113: oid 17 updating version 0 to 11 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:113: oid 17 version 11 is already newer than 11 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:113: oid 17 version 11 is already newer than 11 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:113: oid 17 version 11 is already newer than 11 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 17 v 11 (ObjNum 74 snap 8 seq_num 74) dirty exists 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:113: left oid 17 (ObjNum 74 snap 8 seq_num 74) 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:112: finishing write tid 1 to trial11441570-45 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:112: finishing write tid 2 to trial11441570-45 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:112: finishing write tid 3 to trial11441570-45 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:112: finishing write tid 4 to trial11441570-45 2026-02-20T13:05:32.393 INFO:tasks.rados.rados.0.trial114.stdout:112: finishing write tid 5 to trial11441570-45 2026-02-20T13:05:32.394 INFO:tasks.rados.rados.0.trial114.stdout:112: oid 45 updating version 0 to 36 2026-02-20T13:05:32.394 INFO:tasks.rados.rados.0.trial114.stdout:112: oid 45 version 36 is already newer than 36 2026-02-20T13:05:32.394 INFO:tasks.rados.rados.0.trial114.stdout:112: oid 45 version 36 is already newer than 36 2026-02-20T13:05:32.394 INFO:tasks.rados.rados.0.trial114.stdout:112: oid 45 version 36 is already newer than 36 2026-02-20T13:05:32.394 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 45 v 36 (ObjNum 73 snap 8 seq_num 73) dirty exists 2026-02-20T13:05:32.394 INFO:tasks.rados.rados.0.trial114.stdout:112: left oid 45 (ObjNum 73 snap 8 seq_num 73) 2026-02-20T13:05:32.444 INFO:tasks.rados.rados.0.trial114.stdout:118: finishing write tid 1 to trial11441570-37 2026-02-20T13:05:32.448 INFO:tasks.rados.rados.0.trial114.stdout:118: finishing write tid 2 to trial11441570-37 2026-02-20T13:05:32.452 INFO:tasks.rados.rados.0.trial114.stdout:118: finishing write tid 3 to trial11441570-37 2026-02-20T13:05:32.454 INFO:tasks.rados.rados.0.trial114.stdout:118: finishing write tid 4 to trial11441570-37 2026-02-20T13:05:32.456 INFO:tasks.rados.rados.0.trial114.stdout:118: finishing write tid 5 to trial11441570-37 2026-02-20T13:05:32.456 INFO:tasks.rados.rados.0.trial114.stdout:118: oid 37 updating version 0 to 45 2026-02-20T13:05:32.456 INFO:tasks.rados.rados.0.trial114.stdout:118: oid 37 version 45 is already newer than 45 2026-02-20T13:05:32.456 INFO:tasks.rados.rados.0.trial114.stdout:118: oid 37 version 45 is already newer than 45 2026-02-20T13:05:32.456 INFO:tasks.rados.rados.0.trial114.stdout:118: oid 37 version 45 is already newer than 45 2026-02-20T13:05:32.456 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 37 v 45 (ObjNum 76 snap 8 seq_num 76) dirty exists 2026-02-20T13:05:32.456 INFO:tasks.rados.rados.0.trial114.stdout:118: left oid 37 (ObjNum 76 snap 8 seq_num 76) 2026-02-20T13:05:33.271 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:05:33.349 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:33.344+0000 7f954041a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:33.351 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:33.347+0000 7f954041a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:33.380 INFO:tasks.rados.rados.0.trial114.stdout:110: done (6 left) 2026-02-20T13:05:33.380 INFO:tasks.rados.rados.0.trial114.stdout:111: done (5 left) 2026-02-20T13:05:33.381 INFO:tasks.rados.rados.0.trial114.stdout:112: done (4 left) 2026-02-20T13:05:33.381 INFO:tasks.rados.rados.0.trial114.stdout:113: done (3 left) 2026-02-20T13:05:33.381 INFO:tasks.rados.rados.0.trial114.stdout:117: done (2 left) 2026-02-20T13:05:33.381 INFO:tasks.rados.rados.0.trial114.stdout:118: done (1 left) 2026-02-20T13:05:33.381 INFO:tasks.rados.rados.0.trial114.stdout:119: done (0 left) 2026-02-20T13:05:33.381 INFO:tasks.rados.rados.0.trial114.stdout:120: read oid 33 snap -1 2026-02-20T13:05:33.381 INFO:tasks.rados.rados.0.trial114.stdout:120: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-20T13:05:33.381 INFO:tasks.rados.rados.0.trial114.stdout:121: snap_create 2026-02-20T13:05:33.403 INFO:tasks.rados.rados.0.trial114.stdout:120: expect (ObjNum 32 snap 0 seq_num 32) 2026-02-20T13:05:33.419 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:34.382 INFO:tasks.rados.rados.0.trial114.stdout:120: done (1 left) 2026-02-20T13:05:34.382 INFO:tasks.rados.rados.0.trial114.stdout:121: done (0 left) 2026-02-20T13:05:34.383 INFO:tasks.rados.rados.0.trial114.stdout:122: read oid 17 snap -1 2026-02-20T13:05:34.383 INFO:tasks.rados.rados.0.trial114.stdout:122: expect (ObjNum 74 snap 8 seq_num 74) 2026-02-20T13:05:34.383 INFO:tasks.rados.rados.0.trial114.stdout:123: snap_create 2026-02-20T13:05:34.412 INFO:tasks.rados.rados.0.trial114.stdout:122: expect (ObjNum 74 snap 8 seq_num 74) 2026-02-20T13:05:34.483 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 219469 2026-02-20T13:05:34.768 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [2, 3, 0, 1] 2026-02-20T13:05:34.768 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:05:34.769 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [2, 3, 0, 1] 2026-02-20T13:05:34.769 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T13:05:34.769 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:05:34.829 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T13:05:35.385 INFO:tasks.rados.rados.0.trial114.stdout:122: done (1 left) 2026-02-20T13:05:35.385 INFO:tasks.rados.rados.0.trial114.stdout:123: done (0 left) 2026-02-20T13:05:35.385 INFO:tasks.rados.rados.0.trial114.stdout:124: snap_create 2026-02-20T13:05:35.426 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:05:35.501 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:35.497+0000 7fc4226c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:35.504 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:35.501+0000 7fc4226c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:36.389 INFO:tasks.rados.rados.0.trial114.stdout:124: done (0 left) 2026-02-20T13:05:36.390 INFO:tasks.rados.rados.0.trial114.stdout:125: snap_remove snap 11 2026-02-20T13:05:37.396 INFO:tasks.rados.rados.0.trial114.stdout:125: done (0 left) 2026-02-20T13:05:37.396 INFO:tasks.rados.rados.0.trial114.stdout:126: write (excl) oid 26 current snap is 12 2026-02-20T13:05:37.396 INFO:tasks.rados.rados.0.trial114.stdout:126: seq_num 77 ranges {494139=557703,1455937=734021,2948041=346098} 2026-02-20T13:05:37.399 INFO:tasks.rados.rados.0.trial114.stdout:126: writing trial11441570-26 from 494139 to 1051842 tid 1 2026-02-20T13:05:37.404 INFO:tasks.rados.rados.0.trial114.stdout:126: writing trial11441570-26 from 1455937 to 2189958 tid 2 2026-02-20T13:05:37.408 INFO:tasks.rados.rados.0.trial114.stdout:126: writing trial11441570-26 from 2948041 to 3294139 tid 3 2026-02-20T13:05:37.408 INFO:tasks.rados.rados.0.trial114.stdout:127: snap_remove snap 10 2026-02-20T13:05:38.400 INFO:tasks.rados.rados.0.trial114.stdout:127: done (1 left) 2026-02-20T13:05:38.400 INFO:tasks.rados.rados.0.trial114.stdout:128: read oid 7 snap -1 2026-02-20T13:05:38.400 INFO:tasks.rados.rados.0.trial114.stdout:128: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:05:38.400 INFO:tasks.rados.rados.0.trial114.stdout:129: delete oid 3 current snap is 12 2026-02-20T13:05:38.400 INFO:tasks.rados.rados.0.trial114.stdout:126: finishing write tid 1 to trial11441570-26 2026-02-20T13:05:38.400 INFO:tasks.rados.rados.0.trial114.stdout:126: finishing write tid 2 to trial11441570-26 2026-02-20T13:05:38.400 INFO:tasks.rados.rados.0.trial114.stdout:126: finishing write tid 3 to trial11441570-26 2026-02-20T13:05:38.400 INFO:tasks.rados.rados.0.trial114.stdout:126: finishing write tid 4 to trial11441570-26 2026-02-20T13:05:38.401 INFO:tasks.rados.rados.0.trial114.stdout:126: finishing write tid 5 to trial11441570-26 2026-02-20T13:05:38.401 INFO:tasks.rados.rados.0.trial114.stdout:126: oid 26 updating version 0 to 27 2026-02-20T13:05:38.401 INFO:tasks.rados.rados.0.trial114.stdout:126: oid 26 version 27 is already newer than 27 2026-02-20T13:05:38.401 INFO:tasks.rados.rados.0.trial114.stdout:126: oid 26 version 27 is already newer than 24 2026-02-20T13:05:38.401 INFO:tasks.rados.rados.0.trial114.stdout:126: oid 26 version 27 is already newer than 27 2026-02-20T13:05:38.401 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 26 v 27 (ObjNum 77 snap 12 seq_num 77) dirty exists 2026-02-20T13:05:38.401 INFO:tasks.rados.rados.0.trial114.stdout:126: left oid 26 (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:05:38.431 INFO:tasks.rados.rados.0.trial114.stdout:128: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:05:38.433 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1631716 2026-02-20T13:05:38.442 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:39.830 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [0] live_osds: [2, 3, 1] 2026-02-20T13:05:39.830 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:05:39.830 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2026-02-20T13:05:39.830 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T13:05:39.830 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T13:05:39.836 INFO:tasks.ceph.osd.0:Started 2026-02-20T13:05:39.836 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-20T13:05:39.909 INFO:teuthology.orchestra.run.trial114.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:05:39.912 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:05:39.912 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-20T13:05:44.913 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-20T13:05:45.508 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T13:05:45.548 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:05:45.549 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:05:45.657 INFO:teuthology.orchestra.run.trial114.stdout:{ 2026-02-20T13:05:45.657 INFO:teuthology.orchestra.run.trial114.stdout: "ops_in_flight": [] 2026-02-20T13:05:45.657 INFO:teuthology.orchestra.run.trial114.stdout:} 2026-02-20T13:05:47.550 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:05:47.625 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:47.621+0000 7f4c50c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:47.628 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:47.625+0000 7f4c50c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:49.690 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:05:49.764 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:49.760+0000 7f6725b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:49.767 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:49.764+0000 7f6725b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:50.004 INFO:tasks.rados.rados.0.trial114.stdout:126: done (2 left) 2026-02-20T13:05:50.004 INFO:tasks.rados.rados.0.trial114.stdout:128: done (1 left) 2026-02-20T13:05:50.005 INFO:tasks.rados.rados.0.trial114.stdout:129: done (0 left) 2026-02-20T13:05:50.005 INFO:tasks.rados.rados.0.trial114.stdout:130: snap_remove snap 9 2026-02-20T13:05:50.654 INFO:tasks.rados.rados.0.trial114.stdout:130: done (0 left) 2026-02-20T13:05:50.654 INFO:tasks.rados.rados.0.trial114.stdout:131: write (excl) oid 16 current snap is 12 2026-02-20T13:05:50.655 INFO:tasks.rados.rados.0.trial114.stdout:131: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2026-02-20T13:05:50.658 INFO:tasks.rados.rados.0.trial114.stdout:131: writing trial11441570-16 from 527753 to 1235954 tid 1 2026-02-20T13:05:50.664 INFO:tasks.rados.rados.0.trial114.stdout:131: writing trial11441570-16 from 1856548 to 2594238 tid 2 2026-02-20T13:05:50.666 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [2, 3, 1, 0] 2026-02-20T13:05:50.666 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:05:50.666 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [2, 3, 1, 0] 2026-02-20T13:05:50.667 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T13:05:50.667 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:05:50.667 INFO:tasks.rados.rados.0.trial114.stdout:131: writing trial11441570-16 from 3286534 to 3327753 tid 3 2026-02-20T13:05:50.668 INFO:tasks.rados.rados.0.trial114.stdout:132: write (excl) oid 25 current snap is 12 2026-02-20T13:05:50.668 INFO:tasks.rados.rados.0.trial114.stdout:132: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2026-02-20T13:05:50.672 INFO:tasks.rados.rados.0.trial114.stdout:132: writing trial11441570-25 from 544560 to 1328010 tid 1 2026-02-20T13:05:50.676 INFO:tasks.rados.rados.0.trial114.stdout:132: writing trial11441570-25 from 1915030 to 2396378 tid 2 2026-02-20T13:05:50.679 INFO:tasks.rados.rados.0.trial114.stdout:132: writing trial11441570-25 from 2797604 to 3277365 tid 3 2026-02-20T13:05:50.679 INFO:tasks.rados.rados.0.trial114.stdout:133: write (excl) oid 46 current snap is 12 2026-02-20T13:05:50.679 INFO:tasks.rados.rados.0.trial114.stdout:133: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2026-02-20T13:05:50.683 INFO:tasks.rados.rados.0.trial114.stdout:133: writing trial11441570-46 from 561367 to 1020066 tid 1 2026-02-20T13:05:50.688 INFO:tasks.rados.rados.0.trial114.stdout:133: writing trial11441570-46 from 1573512 to 2314871 tid 2 2026-02-20T13:05:50.693 INFO:tasks.rados.rados.0.trial114.stdout:133: writing trial11441570-46 from 2941380 to 3361367 tid 3 2026-02-20T13:05:50.693 INFO:tasks.rados.rados.0.trial114.stdout:134: read oid 43 snap 8 2026-02-20T13:05:50.693 INFO:tasks.rados.rados.0.trial114.stdout:134: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-20T13:05:50.693 INFO:tasks.rados.rados.0.trial114.stdout:135: write (excl) oid 33 current snap is 12 2026-02-20T13:05:50.693 INFO:tasks.rados.rados.0.trial114.stdout:135: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2026-02-20T13:05:50.696 INFO:tasks.rados.rados.0.trial114.stdout:135: writing trial11441570-33 from 578174 to 1112122 tid 1 2026-02-20T13:05:50.700 INFO:tasks.rados.rados.0.trial114.stdout:135: writing trial11441570-33 from 1515641 to 2000658 tid 2 2026-02-20T13:05:50.705 INFO:tasks.rados.rados.0.trial114.stdout:135: writing trial11441570-33 from 2736097 to 3238402 tid 3 2026-02-20T13:05:50.705 INFO:tasks.rados.rados.0.trial114.stdout:136: read oid 3 snap -1 2026-02-20T13:05:50.705 INFO:tasks.rados.rados.0.trial114.stdout:136: expect deleted 2026-02-20T13:05:50.705 INFO:tasks.rados.rados.0.trial114.stdout:137: delete oid 34 current snap is 12 2026-02-20T13:05:50.729 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T13:05:50.738 INFO:tasks.rados.rados.0.trial114.stdout:134: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-20T13:05:50.761 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2030700 2026-02-20T13:05:50.767 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:05:50.790 INFO:tasks.rados.rados.0.trial114.stdout:132: finishing write tid 1 to trial11441570-25 2026-02-20T13:05:50.790 INFO:tasks.rados.rados.0.trial114.stdout:131: finishing write tid 1 to trial11441570-16 2026-02-20T13:05:50.790 INFO:tasks.rados.rados.0.trial114.stdout:132: finishing write tid 2 to trial11441570-25 2026-02-20T13:05:50.790 INFO:tasks.rados.rados.0.trial114.stdout:132: finishing write tid 3 to trial11441570-25 2026-02-20T13:05:50.791 INFO:tasks.rados.rados.0.trial114.stdout:131: finishing write tid 2 to trial11441570-16 2026-02-20T13:05:50.791 INFO:tasks.rados.rados.0.trial114.stdout:132: finishing write tid 4 to trial11441570-25 2026-02-20T13:05:50.792 INFO:tasks.rados.rados.0.trial114.stdout:132: finishing write tid 5 to trial11441570-25 2026-02-20T13:05:50.792 INFO:tasks.rados.rados.0.trial114.stdout:132: oid 25 updating version 0 to 18 2026-02-20T13:05:50.792 INFO:tasks.rados.rados.0.trial114.stdout:132: oid 25 version 18 is already newer than 18 2026-02-20T13:05:50.792 INFO:tasks.rados.rados.0.trial114.stdout:132: oid 25 version 18 is already newer than 15 2026-02-20T13:05:50.792 INFO:tasks.rados.rados.0.trial114.stdout:132: oid 25 version 18 is already newer than 18 2026-02-20T13:05:50.792 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 25 v 18 (ObjNum 80 snap 12 seq_num 80) dirty exists 2026-02-20T13:05:50.793 INFO:tasks.rados.rados.0.trial114.stdout:132: left oid 25 (ObjNum 80 snap 12 seq_num 80) 2026-02-20T13:05:50.796 INFO:tasks.rados.rados.0.trial114.stdout:131: finishing write tid 3 to trial11441570-16 2026-02-20T13:05:50.800 INFO:tasks.rados.rados.0.trial114.stdout:131: finishing write tid 4 to trial11441570-16 2026-02-20T13:05:50.802 INFO:tasks.rados.rados.0.trial114.stdout:131: finishing write tid 5 to trial11441570-16 2026-02-20T13:05:50.802 INFO:tasks.rados.rados.0.trial114.stdout:131: oid 16 updating version 0 to 8 2026-02-20T13:05:50.802 INFO:tasks.rados.rados.0.trial114.stdout:131: oid 16 version 8 is already newer than 8 2026-02-20T13:05:50.802 INFO:tasks.rados.rados.0.trial114.stdout:131: oid 16 version 8 is already newer than 8 2026-02-20T13:05:50.803 INFO:tasks.rados.rados.0.trial114.stdout:131: oid 16 version 8 is already newer than 5 2026-02-20T13:05:50.803 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 16 v 8 (ObjNum 79 snap 12 seq_num 79) dirty exists 2026-02-20T13:05:50.803 INFO:tasks.rados.rados.0.trial114.stdout:131: left oid 16 (ObjNum 79 snap 12 seq_num 79) 2026-02-20T13:05:51.826 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:05:51.906 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:51.901+0000 7f8f50ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:51.908 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:05:51.905+0000 7f8f50ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:05:55.730 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [3, 1, 0] 2026-02-20T13:05:55.730 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:05:55.731 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2026-02-20T13:05:55.731 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T13:05:55.731 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T13:05:55.733 INFO:tasks.ceph.osd.2:Started 2026-02-20T13:05:55.733 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:05:55.806 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:05:55.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:05:55.810 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:06:00.811 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:06:01.911 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:06:01.929 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:06:01.929 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:06:02.344 INFO:teuthology.orchestra.run.trial185.stdout:{ 2026-02-20T13:06:02.344 INFO:teuthology.orchestra.run.trial185.stdout: "ops_in_flight": [] 2026-02-20T13:06:02.344 INFO:teuthology.orchestra.run.trial185.stdout:} 2026-02-20T13:06:03.458 INFO:tasks.rados.rados.0.trial114.stdout:131: done (6 left) 2026-02-20T13:06:03.458 INFO:tasks.rados.rados.0.trial114.stdout:132: done (5 left) 2026-02-20T13:06:03.458 INFO:tasks.rados.rados.0.trial114.stdout:134: done (4 left) 2026-02-20T13:06:03.458 INFO:tasks.rados.rados.0.trial114.stdout:137: done (3 left) 2026-02-20T13:06:03.458 INFO:tasks.rados.rados.0.trial114.stdout:138: delete oid 29 current snap is 12 2026-02-20T13:06:03.469 INFO:tasks.rados.rados.0.trial114.stdout:135: finishing write tid 1 to trial11441570-33 2026-02-20T13:06:03.485 INFO:tasks.rados.rados.0.trial114.stdout:135: finishing write tid 2 to trial11441570-33 2026-02-20T13:06:03.494 INFO:tasks.rados.rados.0.trial114.stdout:138: done (3 left) 2026-02-20T13:06:03.495 INFO:tasks.rados.rados.0.trial114.stdout:139: write oid 50 current snap is 12 2026-02-20T13:06:03.495 INFO:tasks.rados.rados.0.trial114.stdout:139: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2026-02-20T13:06:03.499 INFO:tasks.rados.rados.0.trial114.stdout:139: writing trial11441570-50 from 628595 to 1104643 tid 1 2026-02-20T13:06:03.505 INFO:tasks.rados.rados.0.trial114.stdout:139: writing trial11441570-50 from 1807440 to 2439784 tid 2 2026-02-20T13:06:03.509 INFO:tasks.rados.rados.0.trial114.stdout:139: writing trial11441570-50 from 2934719 to 3387193 tid 3 2026-02-20T13:06:03.509 INFO:tasks.rados.rados.0.trial114.stdout:140: write oid 12 current snap is 12 2026-02-20T13:06:03.509 INFO:tasks.rados.rados.0.trial114.stdout:140: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2026-02-20T13:06:03.513 INFO:tasks.rados.rados.0.trial114.stdout:140: writing trial11441570-12 from 645402 to 1196699 tid 1 2026-02-20T13:06:03.517 INFO:tasks.rados.rados.0.trial114.stdout:140: writing trial11441570-12 from 1749569 to 2241924 tid 2 2026-02-20T13:06:03.522 INFO:tasks.rados.rados.0.trial114.stdout:140: writing trial11441570-12 from 2845789 to 3445402 tid 3 2026-02-20T13:06:03.522 INFO:tasks.rados.rados.0.trial114.stdout:141: snap_remove snap 8 2026-02-20T13:06:03.930 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:06:04.009 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:04.004+0000 7fcb4fbdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:04.012 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:04.008+0000 7fcb4fbdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:04.345 INFO:tasks.rados.rados.0.trial114.stdout:141: done (5 left) 2026-02-20T13:06:04.345 INFO:tasks.rados.rados.0.trial114.stdout:142: snap_create 2026-02-20T13:06:04.346 INFO:tasks.rados.rados.0.trial114.stdout:135: finishing write tid 3 to trial11441570-33 2026-02-20T13:06:04.346 INFO:tasks.rados.rados.0.trial114.stdout:139: finishing write tid 1 to trial11441570-50 2026-02-20T13:06:04.346 INFO:tasks.rados.rados.0.trial114.stdout:135: finishing write tid 4 to trial11441570-33 2026-02-20T13:06:04.346 INFO:tasks.rados.rados.0.trial114.stdout:135: finishing write tid 5 to trial11441570-33 2026-02-20T13:06:04.346 INFO:tasks.rados.rados.0.trial114.stdout:135: oid 33 updating version 0 to 21 2026-02-20T13:06:04.346 INFO:tasks.rados.rados.0.trial114.stdout:135: oid 33 version 21 is already newer than 18 2026-02-20T13:06:04.346 INFO:tasks.rados.rados.0.trial114.stdout:135: oid 33 version 21 is already newer than 21 2026-02-20T13:06:04.346 INFO:tasks.rados.rados.0.trial114.stdout:135: oid 33 version 21 is already newer than 19 2026-02-20T13:06:04.346 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 33 v 21 (ObjNum 82 snap 12 seq_num 82) dirty exists 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:135: left oid 33 (ObjNum 82 snap 12 seq_num 82) 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:139: finishing write tid 2 to trial11441570-50 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:139: finishing write tid 3 to trial11441570-50 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:139: finishing write tid 4 to trial11441570-50 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:139: finishing write tid 5 to trial11441570-50 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:139: oid 50 updating version 0 to 47 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:139: oid 50 version 47 is already newer than 47 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:139: oid 50 version 47 is already newer than 47 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:139: oid 50 version 47 is already newer than 47 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 50 v 47 (ObjNum 85 snap 12 seq_num 85) dirty exists 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:139: left oid 50 (ObjNum 85 snap 12 seq_num 85) 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:140: finishing write tid 1 to trial11441570-12 2026-02-20T13:06:04.347 INFO:tasks.rados.rados.0.trial114.stdout:140: finishing write tid 2 to trial11441570-12 2026-02-20T13:06:04.348 INFO:tasks.rados.rados.0.trial114.stdout:140: finishing write tid 3 to trial11441570-12 2026-02-20T13:06:04.348 INFO:tasks.rados.rados.0.trial114.stdout:140: finishing write tid 4 to trial11441570-12 2026-02-20T13:06:04.348 INFO:tasks.rados.rados.0.trial114.stdout:140: finishing write tid 5 to trial11441570-12 2026-02-20T13:06:04.348 INFO:tasks.rados.rados.0.trial114.stdout:140: oid 12 updating version 0 to 52 2026-02-20T13:06:04.348 INFO:tasks.rados.rados.0.trial114.stdout:140: oid 12 version 52 is already newer than 52 2026-02-20T13:06:04.348 INFO:tasks.rados.rados.0.trial114.stdout:140: oid 12 version 52 is already newer than 52 2026-02-20T13:06:04.348 INFO:tasks.rados.rados.0.trial114.stdout:140: oid 12 version 52 is already newer than 52 2026-02-20T13:06:04.348 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 12 v 52 (ObjNum 86 snap 12 seq_num 86) dirty exists 2026-02-20T13:06:04.348 INFO:tasks.rados.rados.0.trial114.stdout:140: left oid 12 (ObjNum 86 snap 12 seq_num 86) 2026-02-20T13:06:04.428 INFO:tasks.rados.rados.0.trial114.stdout:133: finishing write tid 1 to trial11441570-46 2026-02-20T13:06:04.447 INFO:tasks.rados.rados.0.trial114.stdout:133: finishing write tid 2 to trial11441570-46 2026-02-20T13:06:04.455 INFO:tasks.rados.rados.0.trial114.stdout:133: finishing write tid 3 to trial11441570-46 2026-02-20T13:06:04.501 INFO:tasks.rados.rados.0.trial114.stdout:133: finishing write tid 4 to trial11441570-46 2026-02-20T13:06:04.503 INFO:tasks.rados.rados.0.trial114.stdout:133: finishing write tid 5 to trial11441570-46 2026-02-20T13:06:04.503 INFO:tasks.rados.rados.0.trial114.stdout:133: oid 46 updating version 0 to 43 2026-02-20T13:06:04.503 INFO:tasks.rados.rados.0.trial114.stdout:133: oid 46 version 43 is already newer than 41 2026-02-20T13:06:04.503 INFO:tasks.rados.rados.0.trial114.stdout:133: oid 46 updating version 43 to 46 2026-02-20T13:06:04.503 INFO:tasks.rados.rados.0.trial114.stdout:133: oid 46 version 46 is already newer than 43 2026-02-20T13:06:04.503 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 46 v 46 (ObjNum 81 snap 12 seq_num 81) dirty exists 2026-02-20T13:06:04.503 INFO:tasks.rados.rados.0.trial114.stdout:133: left oid 46 (ObjNum 81 snap 12 seq_num 81) 2026-02-20T13:06:05.349 INFO:tasks.rados.rados.0.trial114.stdout:133: done (5 left) 2026-02-20T13:06:05.349 INFO:tasks.rados.rados.0.trial114.stdout:135: done (4 left) 2026-02-20T13:06:05.349 INFO:tasks.rados.rados.0.trial114.stdout:136: done (3 left) 2026-02-20T13:06:05.349 INFO:tasks.rados.rados.0.trial114.stdout:139: done (2 left) 2026-02-20T13:06:05.349 INFO:tasks.rados.rados.0.trial114.stdout:140: done (1 left) 2026-02-20T13:06:05.349 INFO:tasks.rados.rados.0.trial114.stdout:142: done (0 left) 2026-02-20T13:06:05.349 INFO:tasks.rados.rados.0.trial114.stdout:143: write (excl) oid 45 current snap is 13 2026-02-20T13:06:05.349 INFO:tasks.rados.rados.0.trial114.stdout:143: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2026-02-20T13:06:05.353 INFO:tasks.rados.rados.0.trial114.stdout:143: writing trial11441570-45 from 662209 to 1288755 tid 1 2026-02-20T13:06:05.358 INFO:tasks.rados.rados.0.trial114.stdout:143: writing trial11441570-45 from 1808051 to 2444064 tid 2 2026-02-20T13:06:05.362 INFO:tasks.rados.rados.0.trial114.stdout:143: writing trial11441570-45 from 2873212 to 3462209 tid 3 2026-02-20T13:06:05.362 INFO:tasks.rados.rados.0.trial114.stdout:144: snap_remove snap 12 2026-02-20T13:06:06.071 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:06:06.149 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:06.144+0000 7f50bb5dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:06.152 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:06.148+0000 7f50bb5dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:06.352 INFO:tasks.rados.rados.0.trial114.stdout:144: done (1 left) 2026-02-20T13:06:06.352 INFO:tasks.rados.rados.0.trial114.stdout:145: snap_create 2026-02-20T13:06:06.352 INFO:tasks.rados.rados.0.trial114.stdout:143: finishing write tid 1 to trial11441570-45 2026-02-20T13:06:06.352 INFO:tasks.rados.rados.0.trial114.stdout:143: finishing write tid 2 to trial11441570-45 2026-02-20T13:06:06.352 INFO:tasks.rados.rados.0.trial114.stdout:143: finishing write tid 3 to trial11441570-45 2026-02-20T13:06:06.352 INFO:tasks.rados.rados.0.trial114.stdout:143: finishing write tid 4 to trial11441570-45 2026-02-20T13:06:06.352 INFO:tasks.rados.rados.0.trial114.stdout:143: finishing write tid 5 to trial11441570-45 2026-02-20T13:06:06.352 INFO:tasks.rados.rados.0.trial114.stdout:143: oid 45 updating version 0 to 45 2026-02-20T13:06:06.352 INFO:tasks.rados.rados.0.trial114.stdout:143: oid 45 version 45 is already newer than 42 2026-02-20T13:06:06.353 INFO:tasks.rados.rados.0.trial114.stdout:143: oid 45 version 45 is already newer than 45 2026-02-20T13:06:06.353 INFO:tasks.rados.rados.0.trial114.stdout:143: oid 45 version 45 is already newer than 45 2026-02-20T13:06:06.353 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 45 v 45 (ObjNum 87 snap 13 seq_num 87) dirty exists 2026-02-20T13:06:06.353 INFO:tasks.rados.rados.0.trial114.stdout:143: left oid 45 (ObjNum 87 snap 13 seq_num 87) 2026-02-20T13:06:07.353 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 1, 0, 2] 2026-02-20T13:06:07.353 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:06:07.354 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:06:07.355 INFO:tasks.rados.rados.0.trial114.stdout:143: done (1 left) 2026-02-20T13:06:07.355 INFO:tasks.rados.rados.0.trial114.stdout:145: done (0 left) 2026-02-20T13:06:07.355 INFO:tasks.rados.rados.0.trial114.stdout:146: delete oid 49 current snap is 14 2026-02-20T13:06:07.387 INFO:tasks.rados.rados.0.trial114.stdout:146: done (0 left) 2026-02-20T13:06:07.388 INFO:tasks.rados.rados.0.trial114.stdout:147: write (excl) oid 46 current snap is 14 2026-02-20T13:06:07.388 INFO:tasks.rados.rados.0.trial114.stdout:147: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2026-02-20T13:06:07.393 INFO:tasks.rados.rados.0.trial114.stdout:147: writing trial11441570-46 from 695823 to 1472867 tid 1 2026-02-20T13:06:07.397 INFO:tasks.rados.rados.0.trial114.stdout:147: writing trial11441570-46 from 1925015 to 2564697 tid 2 2026-02-20T13:06:07.400 INFO:tasks.rados.rados.0.trial114.stdout:147: writing trial11441570-46 from 3328058 to 3495823 tid 3 2026-02-20T13:06:07.401 INFO:tasks.rados.rados.0.trial114.stdout:148: snap_remove snap 13 2026-02-20T13:06:07.430 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:07.425+0000 7f992170b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:07.434 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:07.431+0000 7f992170b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:07.544 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:06:07.545 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:06:07.553 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2026-02-20T13:06:07.349213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":78732488,"num_objects":53,"num_object_clones":7,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":259,"num_read_kb":67599,"num_write":411,"num_write_kb":91073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3945916,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":406,"ondisk_log_size":406,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":230184,"kb_used_data":230184,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208436440,"statfs":{"total":213674622976,"available":213438914560,"internally_reserved":0,"allocated":235708416,"data_stored":235708416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2970183,"num_objects":-1,"num_object_clones":1,"num_object_copies":-3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":-1,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":5679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":2684348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.010919"},"pg_stats":[{"pgid":"3.f","version":"65'46","reported_seq":201,"reported_epoch":66,"state":"active+clean+snaptrim","last_fresh":"2026-02-20T13:06:05.352923+0000","last_change":"2026-02-20T13:06:04.358674+0000","last_active":"2026-02-20T13:06:05.352923+0000","last_peered":"2026-02-20T13:06:05.352923+0000","last_clean":"2026-02-20T13:06:05.352923+0000","last_became_active":"2026-02-20T13:06:03.414603+0000","last_became_peered":"2026-02-20T13:06:03.414603+0000","last_unstale":"2026-02-20T13:06:05.352923+0000","last_undegraded":"2026-02-20T13:06:05.352923+0000","last_fullsized":"2026-02-20T13:06:05.352923+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0,"stat_sum":{"num_bytes":8667329,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":1764,"num_write":44,"num_write_kb":13309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":113,"reported_epoch":63,"state":"peering","last_fresh":"2026-02-20T13:06:01.347972+0000","last_change":"2026-02-20T13:06:01.347972+0000","last_active":"2026-02-20T13:06:01.347972+0000","last_peered":"2026-02-20T13:06:00.340222+0000","last_clean":"2026-02-20T13:06:00.340222+0000","last_became_active":"2026-02-20T13:05:46.735493+0000","last_became_peered":"2026-02-20T13:05:46.735493+0000","last_unstale":"2026-02-20T13:06:01.347972+0000","last_undegraded":"2026-02-20T13:06:01.347972+0000","last_fullsized":"2026-02-20T13:06:01.347972+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'40","reported_seq":191,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.348999+0000","last_change":"2026-02-20T13:05:50.690382+0000","last_active":"2026-02-20T13:06:03.348999+0000","last_peered":"2026-02-20T13:06:03.348999+0000","last_clean":"2026-02-20T13:06:03.348999+0000","last_became_active":"2026-02-20T13:05:46.716662+0000","last_became_peered":"2026-02-20T13:05:46.716662+0000","last_unstale":"2026-02-20T13:06:03.348999+0000","last_undegraded":"2026-02-20T13:06:03.348999+0000","last_fullsized":"2026-02-20T13:06:03.348999+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0,"stat_sum":{"num_bytes":12249006,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":4745,"num_write":38,"num_write_kb":10289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'45","reported_seq":195,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.347596+0000","last_change":"2026-02-20T13:05:50.798008+0000","last_active":"2026-02-20T13:06:03.347596+0000","last_peered":"2026-02-20T13:06:03.347596+0000","last_clean":"2026-02-20T13:06:03.347596+0000","last_became_active":"2026-02-20T13:05:46.745657+0000","last_became_peered":"2026-02-20T13:05:46.745657+0000","last_unstale":"2026-02-20T13:06:03.347596+0000","last_undegraded":"2026-02-20T13:06:03.347596+0000","last_fullsized":"2026-02-20T13:06:03.347596+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0,"stat_sum":{"num_bytes":5372576,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":8613,"num_write":41,"num_write_kb":11570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"60'18","reported_seq":147,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-20T13:06:02.343477+0000","last_change":"2026-02-20T13:05:50.789265+0000","last_active":"2026-02-20T13:06:02.343477+0000","last_peered":"2026-02-20T13:06:02.343477+0000","last_clean":"2026-02-20T13:06:02.343477+0000","last_became_active":"2026-02-20T13:05:46.707986+0000","last_became_peered":"2026-02-20T13:05:46.707986+0000","last_unstale":"2026-02-20T13:06:02.343477+0000","last_undegraded":"2026-02-20T13:06:02.343477+0000","last_fullsized":"2026-02-20T13:06:02.343477+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0,"stat_sum":{"num_bytes":3495823,"num_objects":3,"num_object_clones":1,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3786,"num_write":18,"num_write_kb":5067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"60'31","reported_seq":207,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.504800+0000","last_change":"2026-02-20T13:06:03.505354+0000","last_active":"2026-02-20T13:06:03.504800+0000","last_peered":"2026-02-20T13:06:03.504800+0000","last_clean":"2026-02-20T13:06:00.338702+0000","last_became_active":"2026-02-20T13:06:03.420162+0000","last_became_peered":"2026-02-20T13:06:03.420162+0000","last_unstale":"2026-02-20T13:06:03.504800+0000","last_undegraded":"2026-02-20T13:06:03.504800+0000","last_fullsized":"2026-02-20T13:06:03.504800+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":11,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0,"stat_sum":{"num_bytes":7878840,"num_objects":4,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14412,"num_write":26,"num_write_kb":7826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"64'52","reported_seq":218,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.593803+0000","last_change":"2026-02-20T13:06:03.423067+0000","last_active":"2026-02-20T13:06:03.593803+0000","last_peered":"2026-02-20T13:06:03.593803+0000","last_clean":"2026-02-20T13:06:03.593803+0000","last_became_active":"2026-02-20T13:06:03.408270+0000","last_became_peered":"2026-02-20T13:06:03.408270+0000","last_unstale":"2026-02-20T13:06:03.593803+0000","last_undegraded":"2026-02-20T13:06:03.593803+0000","last_fullsized":"2026-02-20T13:06:03.593803+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":11,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0,"stat_sum":{"num_bytes":6267569,"num_objects":8,"num_object_clones":3,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":32,"num_read_kb":14498,"num_write":44,"num_write_kb":12244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"60'8","reported_seq":162,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.348641+0000","last_change":"2026-02-20T13:05:50.781647+0000","last_active":"2026-02-20T13:06:03.348641+0000","last_peered":"2026-02-20T13:06:03.348641+0000","last_clean":"2026-02-20T13:06:03.348641+0000","last_became_active":"2026-02-20T13:05:46.710160+0000","last_became_peered":"2026-02-20T13:05:46.710160+0000","last_unstale":"2026-02-20T13:06:03.348641+0000","last_undegraded":"2026-02-20T13:06:03.348641+0000","last_fullsized":"2026-02-20T13:06:03.348641+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3327753,"num_objects":2,"num_object_clones":1,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3970,"num_write":9,"num_write_kb":2332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":104,"reported_epoch":63,"state":"peering","last_fresh":"2026-02-20T13:06:01.341484+0000","last_change":"2026-02-20T13:06:01.341484+0000","last_active":"2026-02-20T13:06:01.341484+0000","last_peered":"2026-02-20T13:06:00.338232+0000","last_clean":"2026-02-20T13:06:00.338232+0000","last_became_active":"2026-02-20T13:05:46.714367+0000","last_became_peered":"2026-02-20T13:05:46.714367+0000","last_unstale":"2026-02-20T13:06:01.341484+0000","last_undegraded":"2026-02-20T13:06:01.341484+0000","last_fullsized":"2026-02-20T13:06:01.341484+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"64'21","reported_seq":198,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.529149+0000","last_change":"2026-02-20T13:06:03.527869+0000","last_active":"2026-02-20T13:06:03.529149+0000","last_peered":"2026-02-20T13:06:03.529149+0000","last_clean":"2026-02-20T13:06:03.529149+0000","last_became_active":"2026-02-20T13:06:03.431034+0000","last_became_peered":"2026-02-20T13:06:03.431034+0000","last_unstale":"2026-02-20T13:06:03.529149+0000","last_undegraded":"2026-02-20T13:06:03.529149+0000","last_fullsized":"2026-02-20T13:06:03.529149+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":11,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0,"stat_sum":{"num_bytes":3798349,"num_objects":3,"num_object_clones":1,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3099,"num_write":19,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":2901436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":168,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.411656+0000","last_change":"2026-02-20T13:06:03.412630+0000","last_active":"2026-02-20T13:06:03.411656+0000","last_peered":"2026-02-20T13:06:03.411656+0000","last_clean":"2026-02-20T13:06:00.338391+0000","last_became_active":"2026-02-20T13:06:03.392839+0000","last_became_peered":"2026-02-20T13:06:03.392839+0000","last_unstale":"2026-02-20T13:06:03.411656+0000","last_undegraded":"2026-02-20T13:06:03.411656+0000","last_fullsized":"2026-02-20T13:06:03.411656+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"65'37","reported_seq":143,"reported_epoch":65,"state":"active+clean+snaptrim","last_fresh":"2026-02-20T13:06:04.401438+0000","last_change":"2026-02-20T13:06:04.352869+0000","last_active":"2026-02-20T13:06:04.401438+0000","last_peered":"2026-02-20T13:06:04.401438+0000","last_clean":"2026-02-20T13:06:04.401438+0000","last_became_active":"2026-02-20T13:06:03.405426+0000","last_became_peered":"2026-02-20T13:06:03.405426+0000","last_unstale":"2026-02-20T13:06:04.401438+0000","last_undegraded":"2026-02-20T13:06:04.401438+0000","last_fullsized":"2026-02-20T13:06:04.401438+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":4,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6,"num_write":29,"num_write_kb":6614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1044480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":88,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-20T13:06:04.353779+0000","last_change":"2026-02-20T13:06:04.363230+0000","last_active":"2026-02-20T13:06:04.353779+0000","last_peered":"2026-02-20T13:06:04.353779+0000","last_clean":"2026-02-20T13:06:04.353779+0000","last_became_active":"2026-02-20T13:06:03.386999+0000","last_became_peered":"2026-02-20T13:06:03.386999+0000","last_unstale":"2026-02-20T13:06:04.353779+0000","last_undegraded":"2026-02-20T13:06:04.353779+0000","last_fullsized":"2026-02-20T13:06:04.353779+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'13","reported_seq":128,"reported_epoch":63,"state":"peering","last_fresh":"2026-02-20T13:06:01.346248+0000","last_change":"2026-02-20T13:06:01.346248+0000","last_active":"2026-02-20T13:06:01.346248+0000","last_peered":"2026-02-20T13:06:00.339582+0000","last_clean":"2026-02-20T13:06:00.339582+0000","last_became_active":"2026-02-20T13:05:46.711467+0000","last_became_peered":"2026-02-20T13:05:46.711467+0000","last_unstale":"2026-02-20T13:06:01.346248+0000","last_undegraded":"2026-02-20T13:06:01.346248+0000","last_fullsized":"2026-02-20T13:06:01.346248+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0,"stat_sum":{"num_bytes":4019471,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2866,"num_write":13,"num_write_kb":3425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":103,"reported_epoch":63,"state":"peering","last_fresh":"2026-02-20T13:06:01.347364+0000","last_change":"2026-02-20T13:06:01.347364+0000","last_active":"2026-02-20T13:06:01.347364+0000","last_peered":"2026-02-20T13:06:00.339768+0000","last_clean":"2026-02-20T13:06:00.339768+0000","last_became_active":"2026-02-20T13:05:20.406476+0000","last_became_peered":"2026-02-20T13:05:20.406476+0000","last_unstale":"2026-02-20T13:06:01.347364+0000","last_undegraded":"2026-02-20T13:06:01.347364+0000","last_fullsized":"2026-02-20T13:06:01.347364+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":232,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.427574+0000","last_change":"2026-02-20T13:06:03.428099+0000","last_active":"2026-02-20T13:06:03.427574+0000","last_peered":"2026-02-20T13:06:03.427574+0000","last_clean":"2026-02-20T13:06:00.339587+0000","last_became_active":"2026-02-20T13:06:03.411869+0000","last_became_peered":"2026-02-20T13:06:03.411869+0000","last_unstale":"2026-02-20T13:06:03.427574+0000","last_undegraded":"2026-02-20T13:06:03.427574+0000","last_fullsized":"2026-02-20T13:06:03.427574+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'6","reported_seq":70,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-20T13:06:04.385299+0000","last_change":"2026-02-20T13:06:04.388743+0000","last_active":"2026-02-20T13:06:04.385299+0000","last_peered":"2026-02-20T13:06:04.385299+0000","last_clean":"2026-02-20T13:06:04.385299+0000","last_became_active":"2026-02-20T13:06:03.386405+0000","last_became_peered":"2026-02-20T13:06:03.386405+0000","last_unstale":"2026-02-20T13:06:04.385299+0000","last_undegraded":"2026-02-20T13:06:04.385299+0000","last_fullsized":"2026-02-20T13:06:04.385299+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4386561,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":8,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"29'9","reported_seq":103,"reported_epoch":65,"state":"active+clean","last_fresh":"2026-02-20T13:06:04.374133+0000","last_change":"2026-02-20T13:06:04.375925+0000","last_active":"2026-02-20T13:06:04.374133+0000","last_peered":"2026-02-20T13:06:04.374133+0000","last_clean":"2026-02-20T13:06:04.374133+0000","last_became_active":"2026-02-20T13:06:03.397434+0000","last_became_peered":"2026-02-20T13:06:03.397434+0000","last_unstale":"2026-02-20T13:06:04.374133+0000","last_undegraded":"2026-02-20T13:06:04.374133+0000","last_fullsized":"2026-02-20T13:06:04.374133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4974806,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":2695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":168,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.410442+0000","last_change":"2026-02-20T13:06:03.411058+0000","last_active":"2026-02-20T13:06:03.410442+0000","last_peered":"2026-02-20T13:06:03.410442+0000","last_clean":"2026-02-20T13:06:00.339112+0000","last_became_active":"2026-02-20T13:06:03.405929+0000","last_became_peered":"2026-02-20T13:06:03.405929+0000","last_unstale":"2026-02-20T13:06:03.410442+0000","last_undegraded":"2026-02-20T13:06:03.410442+0000","last_fullsized":"2026-02-20T13:06:03.410442+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"49'13","reported_seq":131,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-20T13:06:02.344459+0000","last_change":"2026-02-20T13:05:50.720570+0000","last_active":"2026-02-20T13:06:02.344459+0000","last_peered":"2026-02-20T13:06:02.344459+0000","last_clean":"2026-02-20T13:06:02.344459+0000","last_became_active":"2026-02-20T13:05:46.733009+0000","last_became_peered":"2026-02-20T13:05:46.733009+0000","last_unstale":"2026-02-20T13:06:02.344459+0000","last_undegraded":"2026-02-20T13:06:02.344459+0000","last_fullsized":"2026-02-20T13:06:02.344459+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0,"stat_sum":{"num_bytes":4174581,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7228,"num_write":13,"num_write_kb":3568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-20T13:06:02.345415+0000","last_change":"2026-02-20T13:05:50.666522+0000","last_active":"2026-02-20T13:06:02.345415+0000","last_peered":"2026-02-20T13:06:02.345415+0000","last_clean":"2026-02-20T13:06:02.345415+0000","last_became_active":"2026-02-20T13:05:46.741561+0000","last_became_peered":"2026-02-20T13:05:46.741561+0000","last_unstale":"2026-02-20T13:06:02.345415+0000","last_undegraded":"2026-02-20T13:06:02.345415+0000","last_fullsized":"2026-02-20T13:06:02.345415+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":128,"reported_epoch":63,"state":"active+clean","last_fresh":"2026-02-20T13:06:02.343837+0000","last_change":"2026-02-20T13:05:50.763897+0000","last_active":"2026-02-20T13:06:02.343837+0000","last_peered":"2026-02-20T13:06:02.343837+0000","last_clean":"2026-02-20T13:06:02.343837+0000","last_became_active":"2026-02-20T13:05:46.702568+0000","last_became_peered":"2026-02-20T13:05:46.702568+0000","last_unstale":"2026-02-20T13:06:02.343837+0000","last_undegraded":"2026-02-20T13:06:02.343837+0000","last_fullsized":"2026-02-20T13:06:02.343837+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6722701,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":159,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.351955+0000","last_change":"2026-02-20T13:05:50.671012+0000","last_active":"2026-02-20T13:06:03.351955+0000","last_peered":"2026-02-20T13:06:03.351955+0000","last_clean":"2026-02-20T13:06:03.351955+0000","last_became_active":"2026-02-20T13:05:46.733902+0000","last_became_peered":"2026-02-20T13:05:46.733902+0000","last_unstale":"2026-02-20T13:06:03.351955+0000","last_undegraded":"2026-02-20T13:06:03.351955+0000","last_fullsized":"2026-02-20T13:06:03.351955+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"29'3","reported_seq":166,"reported_epoch":66,"state":"active+clean","last_fresh":"2026-02-20T13:06:05.354953+0000","last_change":"2026-02-20T13:06:04.382880+0000","last_active":"2026-02-20T13:06:05.354953+0000","last_peered":"2026-02-20T13:06:05.354953+0000","last_clean":"2026-02-20T13:06:05.354953+0000","last_became_active":"2026-02-20T13:06:03.401900+0000","last_became_peered":"2026-02-20T13:06:03.401900+0000","last_unstale":"2026-02-20T13:06:05.354953+0000","last_undegraded":"2026-02-20T13:06:05.354953+0000","last_fullsized":"2026-02-20T13:06:05.354953+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2806736,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2560,"num_write":4,"num_write_kb":1334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":168,"reported_epoch":64,"state":"active+clean","last_fresh":"2026-02-20T13:06:03.415088+0000","last_change":"2026-02-20T13:06:03.415887+0000","last_active":"2026-02-20T13:06:03.415088+0000","last_peered":"2026-02-20T13:06:03.415088+0000","last_clean":"2026-02-20T13:06:00.338492+0000","last_became_active":"2026-02-20T13:06:03.396681+0000","last_became_peered":"2026-02-20T13:06:03.396681+0000","last_unstale":"2026-02-20T13:06:03.415088+0000","last_undegraded":"2026-02-20T13:06:03.415088+0000","last_fullsized":"2026-02-20T13:06:03.415088+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":78142101,"num_objects":49,"num_object_clones":7,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":206,"num_read_kb":67553,"num_write":330,"num_write_kb":89965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3945916,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213434478592,"internally_reserved":0,"allocated":240144384,"data_stored":240144384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53347229696,"internally_reserved":0,"allocated":71426048,"data_stored":71426048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213473038336,"internally_reserved":0,"allocated":201584640,"data_stored":201584640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640360,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":65420,"kb_used_data":65420,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52101236,"statfs":{"total":53418655744,"available":53351665664,"internally_reserved":0,"allocated":66990080,"data_stored":66990080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":63,"seq":270582939652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":46320,"kb_used_data":46320,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52120336,"statfs":{"total":53418655744,"available":53371224064,"internally_reserved":0,"allocated":47431680,"data_stored":47431680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":36,"seq":154618822699,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":64068,"kb_used_data":64068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52102588,"statfs":{"total":53418655744,"available":53353050112,"internally_reserved":0,"allocated":65605632,"data_stored":65605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":58,"seq":249108103187,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":54376,"kb_used_data":54376,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52112280,"statfs":{"total":53418655744,"available":53362974720,"internally_reserved":0,"allocated":55681024,"data_stored":55681024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53362974720,"internally_reserved":0,"allocated":55681024,"data_stored":55681024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53353050112,"internally_reserved":0,"allocated":65605632,"data_stored":65605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53409783808,"internally_reserved":0,"allocated":8871936,"data_stored":8871936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53347229696,"internally_reserved":0,"allocated":71426048,"data_stored":71426048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53347229696,"internally_reserved":0,"allocated":71426048,"data_stored":71426048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53418655744,"available":53362974720,"internally_reserved":0,"allocated":55681024,"data_stored":55681024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53418655744,"available":53353050112,"internally_reserved":0,"allocated":65605632,"data_stored":65605632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53418655744,"available":53371224064,"internally_reserved":0,"allocated":47431680,"data_stored":47431680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53418655744,"available":53347229696,"internally_reserved":0,"allocated":71426048,"data_stored":71426048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:06:08.210 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:06:08.288 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:08.284+0000 7fb5506cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:08.290 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:08.287+0000 7fb5506cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:08.358 INFO:tasks.rados.rados.0.trial114.stdout:148: done (1 left) 2026-02-20T13:06:08.358 INFO:tasks.rados.rados.0.trial114.stdout:149: snap_create 2026-02-20T13:06:08.358 INFO:tasks.rados.rados.0.trial114.stdout:147: finishing write tid 1 to trial11441570-46 2026-02-20T13:06:08.358 INFO:tasks.rados.rados.0.trial114.stdout:147: finishing write tid 2 to trial11441570-46 2026-02-20T13:06:08.358 INFO:tasks.rados.rados.0.trial114.stdout:147: finishing write tid 3 to trial11441570-46 2026-02-20T13:06:08.358 INFO:tasks.rados.rados.0.trial114.stdout:147: finishing write tid 4 to trial11441570-46 2026-02-20T13:06:08.358 INFO:tasks.rados.rados.0.trial114.stdout:147: finishing write tid 5 to trial11441570-46 2026-02-20T13:06:08.358 INFO:tasks.rados.rados.0.trial114.stdout:147: oid 46 updating version 0 to 51 2026-02-20T13:06:08.359 INFO:tasks.rados.rados.0.trial114.stdout:147: oid 46 version 51 is already newer than 51 2026-02-20T13:06:08.359 INFO:tasks.rados.rados.0.trial114.stdout:147: oid 46 version 51 is already newer than 51 2026-02-20T13:06:08.359 INFO:tasks.rados.rados.0.trial114.stdout:147: oid 46 version 51 is already newer than 48 2026-02-20T13:06:08.359 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 46 v 51 (ObjNum 89 snap 14 seq_num 89) dirty exists 2026-02-20T13:06:08.359 INFO:tasks.rados.rados.0.trial114.stdout:147: left oid 46 (ObjNum 89 snap 14 seq_num 89) 2026-02-20T13:06:09.330 INFO:tasks.rados.rados.0.trial114.stdout:147: done (1 left) 2026-02-20T13:06:09.330 INFO:tasks.rados.rados.0.trial114.stdout:149: done (0 left) 2026-02-20T13:06:09.330 INFO:tasks.rados.rados.0.trial114.stdout:150: snap_create 2026-02-20T13:06:10.330 INFO:tasks.rados.rados.0.trial114.stdout:150: done (0 left) 2026-02-20T13:06:10.331 INFO:tasks.rados.rados.0.trial114.stdout:151: read oid 2 snap -1 2026-02-20T13:06:10.331 INFO:tasks.rados.rados.0.trial114.stdout:151: expect (ObjNum 51 snap 0 seq_num 51) 2026-02-20T13:06:10.331 INFO:tasks.rados.rados.0.trial114.stdout:152: snap_remove snap 15 2026-02-20T13:06:10.350 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:06:10.425 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:10.420+0000 7fbd46174640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:10.427 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:10.424+0000 7fbd46174640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:11.332 INFO:tasks.rados.rados.0.trial114.stdout:152: done (1 left) 2026-02-20T13:06:11.332 INFO:tasks.rados.rados.0.trial114.stdout:153: write (excl) oid 40 current snap is 16 2026-02-20T13:06:11.333 INFO:tasks.rados.rados.0.trial114.stdout:153: seq_num 90 ranges {712630=452293,1583497=499693,2555481=425187} 2026-02-20T13:06:11.337 INFO:tasks.rados.rados.0.trial114.stdout:153: writing trial11441570-40 from 712630 to 1164923 tid 1 2026-02-20T13:06:11.341 INFO:tasks.rados.rados.0.trial114.stdout:153: writing trial11441570-40 from 1583497 to 2083190 tid 2 2026-02-20T13:06:11.344 INFO:tasks.rados.rados.0.trial114.stdout:153: writing trial11441570-40 from 2555481 to 2980668 tid 3 2026-02-20T13:06:11.345 INFO:tasks.rados.rados.0.trial114.stdout:154: read oid 19 snap 14 2026-02-20T13:06:11.345 INFO:tasks.rados.rados.0.trial114.stdout:154: expect deleted 2026-02-20T13:06:11.345 INFO:tasks.rados.rados.0.trial114.stdout:155: write (excl) oid 34 current snap is 16 2026-02-20T13:06:11.345 INFO:tasks.rados.rados.0.trial114.stdout:155: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2026-02-20T13:06:11.349 INFO:tasks.rados.rados.0.trial114.stdout:155: writing trial11441570-34 from 729437 to 1256979 tid 1 2026-02-20T13:06:11.354 INFO:tasks.rados.rados.0.trial114.stdout:155: writing trial11441570-34 from 1925626 to 2568977 tid 2 2026-02-20T13:06:11.358 INFO:tasks.rados.rados.0.trial114.stdout:155: writing trial11441570-34 from 3266551 to 3529437 tid 3 2026-02-20T13:06:11.358 INFO:tasks.rados.rados.0.trial114.stdout:156: read oid 5 snap 14 2026-02-20T13:06:11.359 INFO:tasks.rados.rados.0.trial114.stdout:156: expect deleted 2026-02-20T13:06:11.359 INFO:tasks.rados.rados.0.trial114.stdout:157: read oid 38 snap -1 2026-02-20T13:06:11.359 INFO:tasks.rados.rados.0.trial114.stdout:157: expect deleted 2026-02-20T13:06:11.359 INFO:tasks.rados.rados.0.trial114.stdout:158: delete oid 29 current snap is 16 2026-02-20T13:06:11.359 INFO:tasks.rados.rados.0.trial114.stdout:151: expect (ObjNum 51 snap 0 seq_num 51) 2026-02-20T13:06:11.359 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:11.391 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:11.429 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1181055 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:151: done (6 left) 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:158: done (5 left) 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:159: write oid 18 current snap is 16 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:155: finishing write tid 1 to trial11441570-34 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:155: finishing write tid 2 to trial11441570-34 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:155: finishing write tid 3 to trial11441570-34 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:155: finishing write tid 4 to trial11441570-34 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:155: finishing write tid 5 to trial11441570-34 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:155: oid 34 updating version 0 to 40 2026-02-20T13:06:11.453 INFO:tasks.rados.rados.0.trial114.stdout:155: oid 34 updating version 40 to 43 2026-02-20T13:06:11.454 INFO:tasks.rados.rados.0.trial114.stdout:155: oid 34 version 43 is already newer than 43 2026-02-20T13:06:11.454 INFO:tasks.rados.rados.0.trial114.stdout:155: oid 34 version 43 is already newer than 43 2026-02-20T13:06:11.454 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 34 v 43 (ObjNum 91 snap 16 seq_num 91) dirty exists 2026-02-20T13:06:11.454 INFO:tasks.rados.rados.0.trial114.stdout:155: left oid 34 (ObjNum 91 snap 16 seq_num 91) 2026-02-20T13:06:11.454 INFO:tasks.rados.rados.0.trial114.stdout:153: finishing write tid 1 to trial11441570-40 2026-02-20T13:06:11.454 INFO:tasks.rados.rados.0.trial114.stdout:159: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2026-02-20T13:06:11.459 INFO:tasks.rados.rados.0.trial114.stdout:159: writing trial11441570-18 from 763051 to 1557444 tid 1 2026-02-20T13:06:11.463 INFO:tasks.rados.rados.0.trial114.stdout:159: writing trial11441570-18 from 2158943 to 2805963 tid 2 2026-02-20T13:06:11.467 INFO:tasks.rados.rados.0.trial114.stdout:159: writing trial11441570-18 from 3437750 to 3563051 tid 3 2026-02-20T13:06:11.467 INFO:tasks.rados.rados.0.trial114.stdout:154: done (5 left) 2026-02-20T13:06:11.467 INFO:tasks.rados.rados.0.trial114.stdout:155: done (4 left) 2026-02-20T13:06:11.467 INFO:tasks.rados.rados.0.trial114.stdout:156: done (3 left) 2026-02-20T13:06:11.467 INFO:tasks.rados.rados.0.trial114.stdout:160: snap_remove snap 14 2026-02-20T13:06:12.366 INFO:tasks.rados.rados.0.trial114.stdout:160: done (3 left) 2026-02-20T13:06:12.366 INFO:tasks.rados.rados.0.trial114.stdout:161: read oid 20 snap -1 2026-02-20T13:06:12.366 INFO:tasks.rados.rados.0.trial114.stdout:161: expect (ObjNum 19 snap 0 seq_num 19) 2026-02-20T13:06:12.366 INFO:tasks.rados.rados.0.trial114.stdout:162: delete oid 13 current snap is 16 2026-02-20T13:06:12.366 INFO:tasks.rados.rados.0.trial114.stdout:153: finishing write tid 2 to trial11441570-40 2026-02-20T13:06:12.366 INFO:tasks.rados.rados.0.trial114.stdout:153: finishing write tid 3 to trial11441570-40 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:153: finishing write tid 4 to trial11441570-40 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:153: finishing write tid 5 to trial11441570-40 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:153: oid 40 updating version 0 to 58 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:153: oid 40 version 58 is already newer than 58 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:153: oid 40 version 58 is already newer than 58 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:153: oid 40 version 58 is already newer than 55 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 40 v 58 (ObjNum 90 snap 16 seq_num 90) dirty exists 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:153: left oid 40 (ObjNum 90 snap 16 seq_num 90) 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:159: finishing write tid 1 to trial11441570-18 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:159: finishing write tid 2 to trial11441570-18 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:159: finishing write tid 3 to trial11441570-18 2026-02-20T13:06:12.367 INFO:tasks.rados.rados.0.trial114.stdout:159: finishing write tid 4 to trial11441570-18 2026-02-20T13:06:12.368 INFO:tasks.rados.rados.0.trial114.stdout:159: finishing write tid 5 to trial11441570-18 2026-02-20T13:06:12.368 INFO:tasks.rados.rados.0.trial114.stdout:159: oid 18 updating version 0 to 38 2026-02-20T13:06:12.368 INFO:tasks.rados.rados.0.trial114.stdout:159: oid 18 version 38 is already newer than 38 2026-02-20T13:06:12.368 INFO:tasks.rados.rados.0.trial114.stdout:159: oid 18 version 38 is already newer than 38 2026-02-20T13:06:12.368 INFO:tasks.rados.rados.0.trial114.stdout:159: oid 18 version 38 is already newer than 38 2026-02-20T13:06:12.368 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 18 v 38 (ObjNum 93 snap 16 seq_num 93) dirty exists 2026-02-20T13:06:12.368 INFO:tasks.rados.rados.0.trial114.stdout:159: left oid 18 (ObjNum 93 snap 16 seq_num 93) 2026-02-20T13:06:12.394 INFO:tasks.rados.rados.0.trial114.stdout:153: done (4 left) 2026-02-20T13:06:12.394 INFO:tasks.rados.rados.0.trial114.stdout:157: done (3 left) 2026-02-20T13:06:12.394 INFO:tasks.rados.rados.0.trial114.stdout:159: done (2 left) 2026-02-20T13:06:12.394 INFO:tasks.rados.rados.0.trial114.stdout:162: done (1 left) 2026-02-20T13:06:12.394 INFO:tasks.rados.rados.0.trial114.stdout:163: delete oid 3 current snap is 16 2026-02-20T13:06:12.401 INFO:tasks.rados.rados.0.trial114.stdout:161: expect (ObjNum 19 snap 0 seq_num 19) 2026-02-20T13:06:12.462 INFO:tasks.rados.rados.0.trial114.stdout:161: done (1 left) 2026-02-20T13:06:12.462 INFO:tasks.rados.rados.0.trial114.stdout:163: done (0 left) 2026-02-20T13:06:12.463 INFO:tasks.rados.rados.0.trial114.stdout:164: read oid 26 snap -1 2026-02-20T13:06:12.463 INFO:tasks.rados.rados.0.trial114.stdout:164: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:06:12.463 INFO:tasks.rados.rados.0.trial114.stdout:165: write oid 4 current snap is 16 2026-02-20T13:06:12.463 INFO:tasks.rados.rados.0.trial114.stdout:165: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2026-02-20T13:06:12.466 INFO:tasks.rados.rados.0.trial114.stdout:165: writing trial11441570-4 from 413472 to 1033612 tid 1 2026-02-20T13:06:12.472 INFO:tasks.rados.rados.0.trial114.stdout:165: writing trial11441570-4 from 1818036 to 2328736 tid 2 2026-02-20T13:06:12.477 INFO:tasks.rados.rados.0.trial114.stdout:165: writing trial11441570-4 from 3120019 to 3613472 tid 3 2026-02-20T13:06:12.477 INFO:tasks.rados.rados.0.trial114.stdout:166: write (excl) oid 20 current snap is 16 2026-02-20T13:06:12.477 INFO:tasks.rados.rados.0.trial114.stdout:166: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2026-02-20T13:06:12.481 INFO:tasks.rados.rados.0.trial114.stdout:166: writing trial11441570-20 from 430279 to 1125668 tid 1 2026-02-20T13:06:12.484 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:06:12.487 INFO:tasks.rados.rados.0.trial114.stdout:166: writing trial11441570-20 from 1876518 to 2530876 tid 2 2026-02-20T13:06:12.491 INFO:tasks.rados.rados.0.trial114.stdout:166: writing trial11441570-20 from 3031089 to 3567886 tid 3 2026-02-20T13:06:12.491 INFO:tasks.rados.rados.0.trial114.stdout:167: delete oid 49 current snap is 16 2026-02-20T13:06:12.492 INFO:tasks.rados.rados.0.trial114.stdout:164: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:06:12.492 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:12.528 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:12.557 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 1, 0, 2] 2026-02-20T13:06:12.557 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:06:12.557 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:06:12.561 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:12.557+0000 7fa1a6d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:12.564 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:12.561+0000 7fa1a6d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:12.565 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:12.602 INFO:tasks.rados.rados.0.trial114.stdout:164: done (3 left) 2026-02-20T13:06:12.602 INFO:tasks.rados.rados.0.trial114.stdout:167: done (2 left) 2026-02-20T13:06:12.602 INFO:tasks.rados.rados.0.trial114.stdout:168: read oid 21 snap -1 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:168: expect (ObjNum 20 snap 0 seq_num 20) 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:169: write oid 30 current snap is 16 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:165: finishing write tid 1 to trial11441570-4 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:165: finishing write tid 2 to trial11441570-4 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:166: finishing write tid 1 to trial11441570-20 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:165: finishing write tid 3 to trial11441570-4 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:165: finishing write tid 4 to trial11441570-4 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:165: finishing write tid 5 to trial11441570-4 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:165: oid 4 updating version 0 to 10 2026-02-20T13:06:12.603 INFO:tasks.rados.rados.0.trial114.stdout:165: oid 4 version 10 is already newer than 10 2026-02-20T13:06:12.604 INFO:tasks.rados.rados.0.trial114.stdout:165: oid 4 version 10 is already newer than 10 2026-02-20T13:06:12.604 INFO:tasks.rados.rados.0.trial114.stdout:165: oid 4 version 10 is already newer than 10 2026-02-20T13:06:12.604 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 4 v 10 (ObjNum 96 snap 16 seq_num 96) dirty exists 2026-02-20T13:06:12.604 INFO:tasks.rados.rados.0.trial114.stdout:165: left oid 4 (ObjNum 96 snap 16 seq_num 96) 2026-02-20T13:06:12.604 INFO:tasks.rados.rados.0.trial114.stdout:166: finishing write tid 2 to trial11441570-20 2026-02-20T13:06:12.604 INFO:tasks.rados.rados.0.trial114.stdout:169: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2026-02-20T13:06:12.606 INFO:tasks.rados.rados.0.trial114.stdout:169: writing trial11441570-30 from 463893 to 1026133 tid 1 2026-02-20T13:06:12.610 INFO:tasks.rados.rados.0.trial114.stdout:169: writing trial11441570-30 from 1593482 to 2251509 tid 2 2026-02-20T13:06:12.615 INFO:tasks.rados.rados.0.trial114.stdout:169: writing trial11441570-30 from 2685935 to 3245276 tid 3 2026-02-20T13:06:12.615 INFO:tasks.rados.rados.0.trial114.stdout:165: done (3 left) 2026-02-20T13:06:12.615 INFO:tasks.rados.rados.0.trial114.stdout:170: delete oid 38 current snap is 16 2026-02-20T13:06:12.615 INFO:tasks.rados.rados.0.trial114.stdout:166: finishing write tid 3 to trial11441570-20 2026-02-20T13:06:12.615 INFO:tasks.rados.rados.0.trial114.stdout:166: finishing write tid 4 to trial11441570-20 2026-02-20T13:06:12.616 INFO:tasks.rados.rados.0.trial114.stdout:166: finishing write tid 5 to trial11441570-20 2026-02-20T13:06:12.616 INFO:tasks.rados.rados.0.trial114.stdout:166: oid 20 updating version 0 to 13 2026-02-20T13:06:12.616 INFO:tasks.rados.rados.0.trial114.stdout:166: oid 20 version 13 is already newer than 13 2026-02-20T13:06:12.616 INFO:tasks.rados.rados.0.trial114.stdout:166: oid 20 version 13 is already newer than 13 2026-02-20T13:06:12.616 INFO:tasks.rados.rados.0.trial114.stdout:166: oid 20 version 13 is already newer than 10 2026-02-20T13:06:12.616 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 20 v 13 (ObjNum 97 snap 16 seq_num 97) dirty exists 2026-02-20T13:06:12.616 INFO:tasks.rados.rados.0.trial114.stdout:166: left oid 20 (ObjNum 97 snap 16 seq_num 97) 2026-02-20T13:06:12.626 INFO:tasks.rados.rados.0.trial114.stdout:168: expect (ObjNum 20 snap 0 seq_num 20) 2026-02-20T13:06:12.626 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 505777 2026-02-20T13:06:12.638 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:12.632+0000 7f033317b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:12.640 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:12.638+0000 7f033317b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:12.664 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:12.684 INFO:tasks.rados.rados.0.trial114.stdout:169: finishing write tid 1 to trial11441570-30 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:169: finishing write tid 2 to trial11441570-30 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:169: finishing write tid 3 to trial11441570-30 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:166: done (3 left) 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:168: done (2 left) 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:170: done (1 left) 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:171: read oid 41 snap -1 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:171: expect (ObjNum 67 snap 5 seq_num 67) 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:172: write (excl) oid 8 current snap is 16 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:169: finishing write tid 4 to trial11441570-30 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:169: finishing write tid 5 to trial11441570-30 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:169: oid 30 updating version 0 to 51 2026-02-20T13:06:12.685 INFO:tasks.rados.rados.0.trial114.stdout:169: oid 30 version 51 is already newer than 51 2026-02-20T13:06:12.686 INFO:tasks.rados.rados.0.trial114.stdout:169: oid 30 version 51 is already newer than 51 2026-02-20T13:06:12.686 INFO:tasks.rados.rados.0.trial114.stdout:169: oid 30 version 51 is already newer than 51 2026-02-20T13:06:12.686 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 30 v 51 (ObjNum 99 snap 16 seq_num 99) dirty exists 2026-02-20T13:06:12.686 INFO:tasks.rados.rados.0.trial114.stdout:169: left oid 30 (ObjNum 99 snap 16 seq_num 99) 2026-02-20T13:06:12.686 INFO:tasks.rados.rados.0.trial114.stdout:172: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2026-02-20T13:06:12.689 INFO:tasks.rados.rados.0.trial114.stdout:172: writing trial11441570-8 from 497507 to 1210245 tid 1 2026-02-20T13:06:12.693 INFO:tasks.rados.rados.0.trial114.stdout:172: writing trial11441570-8 from 1710446 to 2372142 tid 2 2026-02-20T13:06:12.699 INFO:tasks.rados.rados.0.trial114.stdout:172: writing trial11441570-8 from 3140781 to 3697507 tid 3 2026-02-20T13:06:12.699 INFO:tasks.rados.rados.0.trial114.stdout:169: done (2 left) 2026-02-20T13:06:12.699 INFO:tasks.rados.rados.0.trial114.stdout:173: read oid 5 snap -1 2026-02-20T13:06:12.699 INFO:tasks.rados.rados.0.trial114.stdout:173: expect deleted 2026-02-20T13:06:12.699 INFO:tasks.rados.rados.0.trial114.stdout:174: write oid 21 current snap is 16 2026-02-20T13:06:12.699 INFO:tasks.rados.rados.0.trial114.stdout:174: seq_num 102 ranges {514314=787987,1768928=405354,2768204=509510} 2026-02-20T13:06:12.704 INFO:tasks.rados.rados.0.trial114.stdout:174: writing trial11441570-21 from 514314 to 1302301 tid 1 2026-02-20T13:06:12.708 INFO:tasks.rados.rados.0.trial114.stdout:174: writing trial11441570-21 from 1768928 to 2174282 tid 2 2026-02-20T13:06:12.713 INFO:tasks.rados.rados.0.trial114.stdout:174: writing trial11441570-21 from 2768204 to 3277714 tid 3 2026-02-20T13:06:12.713 INFO:tasks.rados.rados.0.trial114.stdout:175: read oid 20 snap -1 2026-02-20T13:06:12.713 INFO:tasks.rados.rados.0.trial114.stdout:175: expect (ObjNum 97 snap 16 seq_num 97) 2026-02-20T13:06:12.713 INFO:tasks.rados.rados.0.trial114.stdout:176: read oid 48 snap -1 2026-02-20T13:06:12.714 INFO:tasks.rados.rados.0.trial114.stdout:176: expect (ObjNum 72 snap 8 seq_num 72) 2026-02-20T13:06:12.714 INFO:tasks.rados.rados.0.trial114.stdout:177: read oid 16 snap -1 2026-02-20T13:06:12.714 INFO:tasks.rados.rados.0.trial114.stdout:177: expect (ObjNum 79 snap 12 seq_num 79) 2026-02-20T13:06:12.714 INFO:tasks.rados.rados.0.trial114.stdout:178: read oid 35 snap -1 2026-02-20T13:06:12.714 INFO:tasks.rados.rados.0.trial114.stdout:178: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-20T13:06:12.714 INFO:tasks.rados.rados.0.trial114.stdout:179: write oid 32 current snap is 16 2026-02-20T13:06:12.714 INFO:tasks.rados.rados.0.trial114.stdout:179: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2026-02-20T13:06:12.716 INFO:tasks.rados.rados.0.trial114.stdout:179: writing trial11441570-32 from 531121 to 994357 tid 1 2026-02-20T13:06:12.721 INFO:tasks.rados.rados.0.trial114.stdout:179: writing trial11441570-32 from 1711057 to 2376422 tid 2 2026-02-20T13:06:12.727 INFO:tasks.rados.rados.0.trial114.stdout:179: writing trial11441570-32 from 3079274 to 3731121 tid 3 2026-02-20T13:06:12.727 INFO:tasks.rados.rados.0.trial114.stdout:180: snap_create 2026-02-20T13:06:12.727 INFO:tasks.rados.rados.0.trial114.stdout:172: finishing write tid 1 to trial11441570-8 2026-02-20T13:06:12.727 INFO:tasks.rados.rados.0.trial114.stdout:171: expect (ObjNum 67 snap 5 seq_num 67) 2026-02-20T13:06:12.761 INFO:teuthology.orchestra.run.trial114.stdout: 2026-02-20T13:06:12.761 INFO:teuthology.orchestra.run.trial114.stderr:dumped all 2026-02-20T13:06:12.764 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:12.774 INFO:teuthology.orchestra.run.trial114.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2026-02-20T13:06:12.362609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":63322429,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":67601,"num_write":422,"num_write_kb":94431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3945916,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":440,"ondisk_log_size":440,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":237812,"kb_used_data":237812,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208428812,"statfs":{"total":213674622976,"available":213431103488,"internally_reserved":0,"allocated":243519488,"data_stored":243519488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14145261,"num_objects":-8,"num_object_clones":-6,"num_object_copies":-24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":-1,"num_read":4,"num_read_kb":2,"num_write":11,"num_write_kb":3358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.007703"},"pg_stats":[{"pgid":"3.f","version":"69'53","reported_seq":228,"reported_epoch":72,"state":"active+clean+snaptrim","last_fresh":"2026-02-20T13:06:11.340856+0000","last_change":"2026-02-20T13:06:11.340856+0000","last_active":"2026-02-20T13:06:11.340856+0000","last_peered":"2026-02-20T13:06:11.340856+0000","last_clean":"2026-02-20T13:06:11.340856+0000","last_became_active":"2026-02-20T13:06:03.414603+0000","last_became_peered":"2026-02-20T13:06:03.414603+0000","last_unstale":"2026-02-20T13:06:11.340856+0000","last_undegraded":"2026-02-20T13:06:11.340856+0000","last_fullsized":"2026-02-20T13:06:11.340856+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0,"stat_sum":{"num_bytes":7351750,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":1765,"num_write":49,"num_write_kb":14857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":146,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-20T13:06:07.362609+0000","last_change":"2026-02-20T13:06:06.364522+0000","last_active":"2026-02-20T13:06:07.362609+0000","last_peered":"2026-02-20T13:06:07.362609+0000","last_clean":"2026-02-20T13:06:07.362609+0000","last_became_active":"2026-02-20T13:06:03.414609+0000","last_became_peered":"2026-02-20T13:06:03.414609+0000","last_unstale":"2026-02-20T13:06:07.362609+0000","last_undegraded":"2026-02-20T13:06:07.362609+0000","last_fullsized":"2026-02-20T13:06:07.362609+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"67'47","reported_seq":213,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.390976+0000","last_change":"2026-02-20T13:06:08.395802+0000","last_active":"2026-02-20T13:06:08.390976+0000","last_peered":"2026-02-20T13:06:08.390976+0000","last_clean":"2026-02-20T13:06:08.390976+0000","last_became_active":"2026-02-20T13:05:46.716662+0000","last_became_peered":"2026-02-20T13:05:46.716662+0000","last_unstale":"2026-02-20T13:06:08.390976+0000","last_undegraded":"2026-02-20T13:06:08.390976+0000","last_fullsized":"2026-02-20T13:06:08.390976+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0,"stat_sum":{"num_bytes":10868046,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":4746,"num_write":43,"num_write_kb":12099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"49'45","reported_seq":213,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.365049+0000","last_change":"2026-02-20T13:06:08.372686+0000","last_active":"2026-02-20T13:06:08.365049+0000","last_peered":"2026-02-20T13:06:08.365049+0000","last_clean":"2026-02-20T13:06:08.365049+0000","last_became_active":"2026-02-20T13:05:46.745657+0000","last_became_peered":"2026-02-20T13:05:46.745657+0000","last_unstale":"2026-02-20T13:06:08.365049+0000","last_undegraded":"2026-02-20T13:06:08.365049+0000","last_fullsized":"2026-02-20T13:06:08.365049+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":5,"snaptrim_duration":0,"stat_sum":{"num_bytes":5372576,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":8613,"num_write":41,"num_write_kb":11570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"65'20","reported_seq":163,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-20T13:06:07.360975+0000","last_change":"2026-02-20T13:06:06.407846+0000","last_active":"2026-02-20T13:06:07.360975+0000","last_peered":"2026-02-20T13:06:07.360975+0000","last_clean":"2026-02-20T13:06:07.360975+0000","last_became_active":"2026-02-20T13:05:46.707986+0000","last_became_peered":"2026-02-20T13:05:46.707986+0000","last_unstale":"2026-02-20T13:06:07.360975+0000","last_undegraded":"2026-02-20T13:06:07.360975+0000","last_fullsized":"2026-02-20T13:06:07.360975+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0,"stat_sum":{"num_bytes":2231025,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":3786,"num_write":18,"num_write_kb":5067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"65'33","reported_seq":235,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.368319+0000","last_change":"2026-02-20T13:06:08.371413+0000","last_active":"2026-02-20T13:06:08.368319+0000","last_peered":"2026-02-20T13:06:08.368319+0000","last_clean":"2026-02-20T13:06:08.368319+0000","last_became_active":"2026-02-20T13:06:03.420162+0000","last_became_peered":"2026-02-20T13:06:03.420162+0000","last_unstale":"2026-02-20T13:06:08.368319+0000","last_undegraded":"2026-02-20T13:06:08.368319+0000","last_fullsized":"2026-02-20T13:06:08.368319+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0,"stat_sum":{"num_bytes":6587116,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":14412,"num_write":26,"num_write_kb":7826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"67'58","reported_seq":246,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.513622+0000","last_change":"2026-02-20T13:06:08.515391+0000","last_active":"2026-02-20T13:06:08.513622+0000","last_peered":"2026-02-20T13:06:08.513622+0000","last_clean":"2026-02-20T13:06:08.513622+0000","last_became_active":"2026-02-20T13:06:03.408270+0000","last_became_peered":"2026-02-20T13:06:03.408270+0000","last_unstale":"2026-02-20T13:06:08.513622+0000","last_undegraded":"2026-02-20T13:06:08.513622+0000","last_fullsized":"2026-02-20T13:06:08.513622+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":8,"snaptrim_duration":0,"stat_sum":{"num_bytes":1040030,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":14498,"num_write":44,"num_write_kb":12244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"65'10","reported_seq":179,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.364499+0000","last_change":"2026-02-20T13:06:08.372937+0000","last_active":"2026-02-20T13:06:08.364499+0000","last_peered":"2026-02-20T13:06:08.364499+0000","last_clean":"2026-02-20T13:06:08.364499+0000","last_became_active":"2026-02-20T13:05:46.710160+0000","last_became_peered":"2026-02-20T13:05:46.710160+0000","last_unstale":"2026-02-20T13:06:08.364499+0000","last_undegraded":"2026-02-20T13:06:08.364499+0000","last_fullsized":"2026-02-20T13:06:08.364499+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0,"stat_sum":{"num_bytes":2223995,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3970,"num_write":9,"num_write_kb":2332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":125,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-20T13:06:07.360778+0000","last_change":"2026-02-20T13:06:04.362529+0000","last_active":"2026-02-20T13:06:07.360778+0000","last_peered":"2026-02-20T13:06:07.360778+0000","last_clean":"2026-02-20T13:06:07.360778+0000","last_became_active":"2026-02-20T13:06:03.386577+0000","last_became_peered":"2026-02-20T13:06:03.386577+0000","last_unstale":"2026-02-20T13:06:07.360778+0000","last_undegraded":"2026-02-20T13:06:07.360778+0000","last_fullsized":"2026-02-20T13:06:07.360778+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"65'23","reported_seq":226,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.367625+0000","last_change":"2026-02-20T13:06:08.370577+0000","last_active":"2026-02-20T13:06:08.367625+0000","last_peered":"2026-02-20T13:06:08.367625+0000","last_clean":"2026-02-20T13:06:08.367625+0000","last_became_active":"2026-02-20T13:06:03.431034+0000","last_became_peered":"2026-02-20T13:06:03.431034+0000","last_unstale":"2026-02-20T13:06:08.367625+0000","last_undegraded":"2026-02-20T13:06:08.367625+0000","last_fullsized":"2026-02-20T13:06:08.367625+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0,"stat_sum":{"num_bytes":2779384,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3099,"num_write":19,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":2901436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":184,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.366997+0000","last_change":"2026-02-20T13:06:04.369708+0000","last_active":"2026-02-20T13:06:08.366997+0000","last_peered":"2026-02-20T13:06:08.366997+0000","last_clean":"2026-02-20T13:06:08.366997+0000","last_became_active":"2026-02-20T13:06:03.392839+0000","last_became_peered":"2026-02-20T13:06:03.392839+0000","last_unstale":"2026-02-20T13:06:08.366997+0000","last_undegraded":"2026-02-20T13:06:08.366997+0000","last_fullsized":"2026-02-20T13:06:08.366997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"65'39","reported_seq":162,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-20T13:06:09.336618+0000","last_change":"2026-02-20T13:06:08.369055+0000","last_active":"2026-02-20T13:06:09.336618+0000","last_peered":"2026-02-20T13:06:09.336618+0000","last_clean":"2026-02-20T13:06:09.336618+0000","last_became_active":"2026-02-20T13:06:03.405426+0000","last_became_peered":"2026-02-20T13:06:03.405426+0000","last_unstale":"2026-02-20T13:06:09.336618+0000","last_undegraded":"2026-02-20T13:06:09.336618+0000","last_fullsized":"2026-02-20T13:06:09.336618+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":6,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":6,"num_write":29,"num_write_kb":6614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1044480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":103,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-20T13:06:09.336944+0000","last_change":"2026-02-20T13:06:04.363230+0000","last_active":"2026-02-20T13:06:09.336944+0000","last_peered":"2026-02-20T13:06:09.336944+0000","last_clean":"2026-02-20T13:06:09.336944+0000","last_became_active":"2026-02-20T13:06:03.386999+0000","last_became_peered":"2026-02-20T13:06:03.386999+0000","last_unstale":"2026-02-20T13:06:09.336944+0000","last_undegraded":"2026-02-20T13:06:09.336944+0000","last_fullsized":"2026-02-20T13:06:09.336944+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"49'13","reported_seq":161,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-20T13:06:07.363028+0000","last_change":"2026-02-20T13:06:06.363854+0000","last_active":"2026-02-20T13:06:07.363028+0000","last_peered":"2026-02-20T13:06:07.363028+0000","last_clean":"2026-02-20T13:06:07.363028+0000","last_became_active":"2026-02-20T13:06:03.397902+0000","last_became_peered":"2026-02-20T13:06:03.397902+0000","last_unstale":"2026-02-20T13:06:07.363028+0000","last_undegraded":"2026-02-20T13:06:07.363028+0000","last_fullsized":"2026-02-20T13:06:07.363028+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0,"stat_sum":{"num_bytes":4019471,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2866,"num_write":13,"num_write_kb":3425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":124,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-20T13:06:07.362195+0000","last_change":"2026-02-20T13:06:04.358936+0000","last_active":"2026-02-20T13:06:07.362195+0000","last_peered":"2026-02-20T13:06:07.362195+0000","last_clean":"2026-02-20T13:06:07.362195+0000","last_became_active":"2026-02-20T13:06:03.387380+0000","last_became_peered":"2026-02-20T13:06:03.387380+0000","last_unstale":"2026-02-20T13:06:07.362195+0000","last_undegraded":"2026-02-20T13:06:07.362195+0000","last_fullsized":"2026-02-20T13:06:07.362195+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":247,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.368478+0000","last_change":"2026-02-20T13:06:03.428099+0000","last_active":"2026-02-20T13:06:08.368478+0000","last_peered":"2026-02-20T13:06:08.368478+0000","last_clean":"2026-02-20T13:06:08.368478+0000","last_became_active":"2026-02-20T13:06:03.411869+0000","last_became_peered":"2026-02-20T13:06:03.411869+0000","last_unstale":"2026-02-20T13:06:08.368478+0000","last_undegraded":"2026-02-20T13:06:08.368478+0000","last_fullsized":"2026-02-20T13:06:08.368478+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"25'6","reported_seq":87,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-20T13:06:09.337708+0000","last_change":"2026-02-20T13:06:08.369797+0000","last_active":"2026-02-20T13:06:09.337708+0000","last_peered":"2026-02-20T13:06:09.337708+0000","last_clean":"2026-02-20T13:06:09.337708+0000","last_became_active":"2026-02-20T13:06:03.386405+0000","last_became_peered":"2026-02-20T13:06:03.386405+0000","last_unstale":"2026-02-20T13:06:09.337708+0000","last_undegraded":"2026-02-20T13:06:09.337708+0000","last_fullsized":"2026-02-20T13:06:09.337708+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4386561,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":8,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"29'9","reported_seq":120,"reported_epoch":70,"state":"active+clean","last_fresh":"2026-02-20T13:06:09.337907+0000","last_change":"2026-02-20T13:06:08.368434+0000","last_active":"2026-02-20T13:06:09.337907+0000","last_peered":"2026-02-20T13:06:09.337907+0000","last_clean":"2026-02-20T13:06:09.337907+0000","last_became_active":"2026-02-20T13:06:03.397434+0000","last_became_peered":"2026-02-20T13:06:03.397434+0000","last_unstale":"2026-02-20T13:06:09.337907+0000","last_undegraded":"2026-02-20T13:06:09.337907+0000","last_fullsized":"2026-02-20T13:06:09.337907+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4974806,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":2695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":184,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.367313+0000","last_change":"2026-02-20T13:06:04.361350+0000","last_active":"2026-02-20T13:06:08.367313+0000","last_peered":"2026-02-20T13:06:08.367313+0000","last_clean":"2026-02-20T13:06:08.367313+0000","last_became_active":"2026-02-20T13:06:03.405929+0000","last_became_peered":"2026-02-20T13:06:03.405929+0000","last_unstale":"2026-02-20T13:06:08.367313+0000","last_undegraded":"2026-02-20T13:06:08.367313+0000","last_fullsized":"2026-02-20T13:06:08.367313+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"49'13","reported_seq":148,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-20T13:06:07.361655+0000","last_change":"2026-02-20T13:06:06.365210+0000","last_active":"2026-02-20T13:06:07.361655+0000","last_peered":"2026-02-20T13:06:07.361655+0000","last_clean":"2026-02-20T13:06:07.361655+0000","last_became_active":"2026-02-20T13:05:46.733009+0000","last_became_peered":"2026-02-20T13:05:46.733009+0000","last_unstale":"2026-02-20T13:06:07.361655+0000","last_undegraded":"2026-02-20T13:06:07.361655+0000","last_fullsized":"2026-02-20T13:06:07.361655+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0,"stat_sum":{"num_bytes":4174581,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":7228,"num_write":13,"num_write_kb":3568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":123,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-20T13:06:07.363319+0000","last_change":"2026-02-20T13:05:50.666522+0000","last_active":"2026-02-20T13:06:07.363319+0000","last_peered":"2026-02-20T13:06:07.363319+0000","last_clean":"2026-02-20T13:06:07.363319+0000","last_became_active":"2026-02-20T13:05:46.741561+0000","last_became_peered":"2026-02-20T13:05:46.741561+0000","last_unstale":"2026-02-20T13:06:07.363319+0000","last_undegraded":"2026-02-20T13:06:07.363319+0000","last_fullsized":"2026-02-20T13:06:07.363319+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":145,"reported_epoch":68,"state":"active+clean","last_fresh":"2026-02-20T13:06:07.360575+0000","last_change":"2026-02-20T13:06:06.363823+0000","last_active":"2026-02-20T13:06:07.360575+0000","last_peered":"2026-02-20T13:06:07.360575+0000","last_clean":"2026-02-20T13:06:07.360575+0000","last_became_active":"2026-02-20T13:05:46.702568+0000","last_became_peered":"2026-02-20T13:05:46.702568+0000","last_unstale":"2026-02-20T13:06:07.360575+0000","last_undegraded":"2026-02-20T13:06:07.360575+0000","last_fullsized":"2026-02-20T13:06:07.360575+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6722701,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":12,"num_write_kb":2775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":174,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.367733+0000","last_change":"2026-02-20T13:05:50.671012+0000","last_active":"2026-02-20T13:06:08.367733+0000","last_peered":"2026-02-20T13:06:08.367733+0000","last_clean":"2026-02-20T13:06:08.367733+0000","last_became_active":"2026-02-20T13:05:46.733902+0000","last_became_peered":"2026-02-20T13:05:46.733902+0000","last_unstale":"2026-02-20T13:06:08.367733+0000","last_undegraded":"2026-02-20T13:06:08.367733+0000","last_fullsized":"2026-02-20T13:06:08.367733+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"69'7","reported_seq":187,"reported_epoch":72,"state":"active+clean","last_fresh":"2026-02-20T13:06:11.342651+0000","last_change":"2026-02-20T13:06:11.345737+0000","last_active":"2026-02-20T13:06:11.342651+0000","last_peered":"2026-02-20T13:06:11.342651+0000","last_clean":"2026-02-20T13:06:11.342651+0000","last_became_active":"2026-02-20T13:06:03.401900+0000","last_became_peered":"2026-02-20T13:06:03.401900+0000","last_unstale":"2026-02-20T13:06:11.342651+0000","last_undegraded":"2026-02-20T13:06:11.342651+0000","last_fullsized":"2026-02-20T13:06:11.342651+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:26.873163+0000","last_clean_scrub_stamp":"2026-02-20T13:04:26.873163+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":2560,"num_write":5,"num_write_kb":1334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":184,"reported_epoch":69,"state":"active+clean","last_fresh":"2026-02-20T13:06:08.366740+0000","last_change":"2026-02-20T13:06:04.370660+0000","last_active":"2026-02-20T13:06:08.366740+0000","last_peered":"2026-02-20T13:06:08.366740+0000","last_clean":"2026-02-20T13:06:08.366740+0000","last_became_active":"2026-02-20T13:06:03.396681+0000","last_became_peered":"2026-02-20T13:06:03.396681+0000","last_unstale":"2026-02-20T13:06:08.366740+0000","last_undegraded":"2026-02-20T13:06:08.366740+0000","last_fullsized":"2026-02-20T13:06:08.366740+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T13:04:19.698980+0000","last_clean_scrub_stamp":"2026-02-20T13:04:19.698980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":62732042,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":67555,"num_write":341,"num_write_kb":93323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3945916,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213432655872,"internally_reserved":0,"allocated":241967104,"data_stored":241967104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":385,"ondisk_log_size":385,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53347512320,"internally_reserved":0,"allocated":71143424,"data_stored":71143424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213471469568,"internally_reserved":0,"allocated":203153408,"data_stored":203153408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640365,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":71000,"kb_used_data":71000,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52095656,"statfs":{"total":53418655744,"available":53345951744,"internally_reserved":0,"allocated":72704000,"data_stored":72704000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":63,"seq":270582939657,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":46568,"kb_used_data":46568,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52120088,"statfs":{"total":53418655744,"available":53370970112,"internally_reserved":0,"allocated":47685632,"data_stored":47685632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":36,"seq":154618822704,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":63996,"kb_used_data":63996,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52102660,"statfs":{"total":53418655744,"available":53353123840,"internally_reserved":0,"allocated":65531904,"data_stored":65531904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":58,"seq":249108103192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":56248,"kb_used_data":56248,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52110408,"statfs":{"total":53418655744,"available":53361057792,"internally_reserved":0,"allocated":57597952,"data_stored":57597952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":53418655744,"available":53361057792,"internally_reserved":0,"allocated":57597952,"data_stored":57597952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":53418655744,"available":53353115648,"internally_reserved":0,"allocated":65540096,"data_stored":65540096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53409783808,"internally_reserved":0,"allocated":8871936,"data_stored":8871936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53347512320,"internally_reserved":0,"allocated":71143424,"data_stored":71143424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53347512320,"internally_reserved":0,"allocated":71143424,"data_stored":71143424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53418655744,"available":53361057792,"internally_reserved":0,"allocated":57597952,"data_stored":57597952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53418655744,"available":53353115648,"internally_reserved":0,"allocated":65540096,"data_stored":65540096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53418655744,"available":53370970112,"internally_reserved":0,"allocated":47685632,"data_stored":47685632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53418655744,"available":53347512320,"internally_reserved":0,"allocated":71143424,"data_stored":71143424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T13:06:12.801 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:12.838 INFO:tasks.rados.rados.0.trial114.stdout:174: finishing write tid 1 to trial11441570-21 2026-02-20T13:06:12.838 INFO:tasks.rados.rados.0.trial114.stdout:174: finishing write tid 2 to trial11441570-21 2026-02-20T13:06:12.838 INFO:tasks.rados.rados.0.trial114.stdout:172: finishing write tid 2 to trial11441570-8 2026-02-20T13:06:12.838 INFO:tasks.rados.rados.0.trial114.stdout:175: expect (ObjNum 97 snap 16 seq_num 97) 2026-02-20T13:06:12.955 INFO:tasks.rados.rados.0.trial114.stdout:172: finishing write tid 3 to trial11441570-8 2026-02-20T13:06:12.955 INFO:tasks.rados.rados.0.trial114.stdout:174: finishing write tid 3 to trial11441570-21 2026-02-20T13:06:12.955 INFO:tasks.rados.rados.0.trial114.stdout:178: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-20T13:06:12.976 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:13.008 INFO:tasks.rados.rados.0.trial114.stdout:172: finishing write tid 4 to trial11441570-8 2026-02-20T13:06:13.008 INFO:tasks.rados.rados.0.trial114.stdout:174: finishing write tid 4 to trial11441570-21 2026-02-20T13:06:13.008 INFO:tasks.rados.rados.0.trial114.stdout:177: expect (ObjNum 79 snap 12 seq_num 79) 2026-02-20T13:06:13.036 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1438124 2026-02-20T13:06:13.079 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2046974 2026-02-20T13:06:13.094 INFO:tasks.rados.rados.0.trial114.stdout:174: finishing write tid 5 to trial11441570-21 2026-02-20T13:06:13.094 INFO:tasks.rados.rados.0.trial114.stdout:174: oid 21 updating version 0 to 14 2026-02-20T13:06:13.094 INFO:tasks.rados.rados.0.trial114.stdout:174: oid 21 version 14 is already newer than 14 2026-02-20T13:06:13.094 INFO:tasks.rados.rados.0.trial114.stdout:174: oid 21 version 14 is already newer than 14 2026-02-20T13:06:13.094 INFO:tasks.rados.rados.0.trial114.stdout:174: oid 21 version 14 is already newer than 14 2026-02-20T13:06:13.094 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 21 v 14 (ObjNum 102 snap 16 seq_num 102) dirty exists 2026-02-20T13:06:13.094 INFO:tasks.rados.rados.0.trial114.stdout:174: left oid 21 (ObjNum 102 snap 16 seq_num 102) 2026-02-20T13:06:13.094 INFO:tasks.rados.rados.0.trial114.stdout:172: finishing write tid 5 to trial11441570-8 2026-02-20T13:06:13.094 INFO:tasks.rados.rados.0.trial114.stdout:172: oid 8 updating version 0 to 13 2026-02-20T13:06:13.095 INFO:tasks.rados.rados.0.trial114.stdout:172: oid 8 version 13 is already newer than 10 2026-02-20T13:06:13.095 INFO:tasks.rados.rados.0.trial114.stdout:172: oid 8 version 13 is already newer than 13 2026-02-20T13:06:13.095 INFO:tasks.rados.rados.0.trial114.stdout:172: oid 8 version 13 is already newer than 13 2026-02-20T13:06:13.095 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 8 v 13 (ObjNum 101 snap 16 seq_num 101) dirty exists 2026-02-20T13:06:13.095 INFO:tasks.rados.rados.0.trial114.stdout:172: left oid 8 (ObjNum 101 snap 16 seq_num 101) 2026-02-20T13:06:13.095 INFO:tasks.rados.rados.0.trial114.stdout:176: expect (ObjNum 72 snap 8 seq_num 72) 2026-02-20T13:06:13.130 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:13.181 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2700207 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:179: finishing write tid 1 to trial11441570-32 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:179: finishing write tid 2 to trial11441570-32 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:179: finishing write tid 3 to trial11441570-32 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:179: finishing write tid 4 to trial11441570-32 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:179: finishing write tid 5 to trial11441570-32 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:179: oid 32 updating version 0 to 49 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:179: oid 32 version 49 is already newer than 49 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:179: oid 32 version 49 is already newer than 49 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:179: oid 32 version 49 is already newer than 49 2026-02-20T13:06:13.190 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 32 v 49 (ObjNum 103 snap 16 seq_num 103) dirty exists 2026-02-20T13:06:13.191 INFO:tasks.rados.rados.0.trial114.stdout:179: left oid 32 (ObjNum 103 snap 16 seq_num 103) 2026-02-20T13:06:13.368 INFO:tasks.rados.rados.0.trial114.stdout:171: done (9 left) 2026-02-20T13:06:13.368 INFO:tasks.rados.rados.0.trial114.stdout:172: done (8 left) 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:173: done (7 left) 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:174: done (6 left) 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:175: done (5 left) 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:176: done (4 left) 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:177: done (3 left) 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:178: done (2 left) 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:179: done (1 left) 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:180: done (0 left) 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:181: write (excl) oid 49 current snap is 17 2026-02-20T13:06:13.369 INFO:tasks.rados.rados.0.trial114.stdout:181: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2026-02-20T13:06:13.372 INFO:tasks.rados.rados.0.trial114.stdout:181: writing trial11441570-49 from 547928 to 1086413 tid 1 2026-02-20T13:06:13.376 INFO:tasks.rados.rados.0.trial114.stdout:181: writing trial11441570-49 from 1769539 to 2178562 tid 2 2026-02-20T13:06:13.381 INFO:tasks.rados.rados.0.trial114.stdout:181: writing trial11441570-49 from 2706697 to 3238751 tid 3 2026-02-20T13:06:13.381 INFO:tasks.rados.rados.0.trial114.stdout:182: snap_create 2026-02-20T13:06:13.397 INFO:tasks.rados.rados.0.trial114.stdout:181: finishing write tid 1 to trial11441570-49 2026-02-20T13:06:13.408 INFO:tasks.rados.rados.0.trial114.stdout:181: finishing write tid 2 to trial11441570-49 2026-02-20T13:06:13.413 INFO:tasks.rados.rados.0.trial114.stdout:181: finishing write tid 3 to trial11441570-49 2026-02-20T13:06:13.416 INFO:tasks.rados.rados.0.trial114.stdout:181: finishing write tid 4 to trial11441570-49 2026-02-20T13:06:13.417 INFO:tasks.rados.rados.0.trial114.stdout:181: finishing write tid 5 to trial11441570-49 2026-02-20T13:06:13.417 INFO:tasks.rados.rados.0.trial114.stdout:181: oid 49 updating version 0 to 12 2026-02-20T13:06:13.418 INFO:tasks.rados.rados.0.trial114.stdout:181: oid 49 version 12 is already newer than 9 2026-02-20T13:06:13.418 INFO:tasks.rados.rados.0.trial114.stdout:181: oid 49 version 12 is already newer than 12 2026-02-20T13:06:13.418 INFO:tasks.rados.rados.0.trial114.stdout:181: oid 49 version 12 is already newer than 12 2026-02-20T13:06:13.418 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 49 v 12 (ObjNum 104 snap 17 seq_num 104) dirty exists 2026-02-20T13:06:13.418 INFO:tasks.rados.rados.0.trial114.stdout:181: left oid 49 (ObjNum 104 snap 17 seq_num 104) 2026-02-20T13:06:14.374 INFO:tasks.rados.rados.0.trial114.stdout:181: done (1 left) 2026-02-20T13:06:14.374 INFO:tasks.rados.rados.0.trial114.stdout:182: done (0 left) 2026-02-20T13:06:14.374 INFO:tasks.rados.rados.0.trial114.stdout:183: read oid 49 snap -1 2026-02-20T13:06:14.374 INFO:tasks.rados.rados.0.trial114.stdout:183: expect (ObjNum 104 snap 17 seq_num 104) 2026-02-20T13:06:14.374 INFO:tasks.rados.rados.0.trial114.stdout:184: read oid 29 snap -1 2026-02-20T13:06:14.374 INFO:tasks.rados.rados.0.trial114.stdout:184: expect deleted 2026-02-20T13:06:14.375 INFO:tasks.rados.rados.0.trial114.stdout:185: delete oid 10 current snap is 18 2026-02-20T13:06:14.405 INFO:tasks.rados.rados.0.trial114.stdout:183: expect (ObjNum 104 snap 17 seq_num 104) 2026-02-20T13:06:14.405 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:14.448 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2792729 2026-02-20T13:06:14.487 INFO:tasks.rados.rados.0.trial114.stdout:183: done (2 left) 2026-02-20T13:06:14.487 INFO:tasks.rados.rados.0.trial114.stdout:184: done (1 left) 2026-02-20T13:06:14.487 INFO:tasks.rados.rados.0.trial114.stdout:185: done (0 left) 2026-02-20T13:06:14.487 INFO:tasks.rados.rados.0.trial114.stdout:186: snap_remove snap 16 2026-02-20T13:06:14.636 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:06:14.714 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:14.710+0000 7f4bd7ab7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:14.716 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:14.713+0000 7f4bd7ab7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:15.376 INFO:tasks.rados.rados.0.trial114.stdout:186: done (0 left) 2026-02-20T13:06:15.376 INFO:tasks.rados.rados.0.trial114.stdout:187: delete oid 47 current snap is 18 2026-02-20T13:06:15.418 INFO:tasks.rados.rados.0.trial114.stdout:187: done (0 left) 2026-02-20T13:06:15.418 INFO:tasks.rados.rados.0.trial114.stdout:188: read oid 25 snap 17 2026-02-20T13:06:15.418 INFO:tasks.rados.rados.0.trial114.stdout:188: expect (ObjNum 80 snap 12 seq_num 80) 2026-02-20T13:06:15.418 INFO:tasks.rados.rados.0.trial114.stdout:189: write (excl) oid 44 current snap is 18 2026-02-20T13:06:15.419 INFO:tasks.rados.rados.0.trial114.stdout:189: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2026-02-20T13:06:15.422 INFO:tasks.rados.rados.0.trial114.stdout:189: writing trial11441570-44 from 598349 to 1078934 tid 1 2026-02-20T13:06:15.426 INFO:tasks.rados.rados.0.trial114.stdout:189: writing trial11441570-44 from 1544985 to 2217688 tid 2 2026-02-20T13:06:15.431 INFO:tasks.rados.rados.0.trial114.stdout:189: writing trial11441570-44 from 2905319 to 3387542 tid 3 2026-02-20T13:06:15.431 INFO:tasks.rados.rados.0.trial114.stdout:190: delete oid 28 current snap is 18 2026-02-20T13:06:15.431 INFO:tasks.rados.rados.0.trial114.stdout:188: expect (ObjNum 80 snap 12 seq_num 80) 2026-02-20T13:06:15.484 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2046264 2026-02-20T13:06:15.501 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:06:15.540 INFO:tasks.rados.rados.0.trial114.stdout:188: done (2 left) 2026-02-20T13:06:15.541 INFO:tasks.rados.rados.0.trial114.stdout:190: done (1 left) 2026-02-20T13:06:15.541 INFO:tasks.rados.rados.0.trial114.stdout:191: write (excl) oid 45 current snap is 18 2026-02-20T13:06:15.541 INFO:tasks.rados.rados.0.trial114.stdout:189: finishing write tid 1 to trial11441570-44 2026-02-20T13:06:15.541 INFO:tasks.rados.rados.0.trial114.stdout:191: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2026-02-20T13:06:15.546 INFO:tasks.rados.rados.0.trial114.stdout:191: writing trial11441570-45 from 631963 to 1263046 tid 1 2026-02-20T13:06:15.551 INFO:tasks.rados.rados.0.trial114.stdout:191: writing trial11441570-45 from 2061949 to 2621968 tid 2 2026-02-20T13:06:15.556 INFO:tasks.rados.rados.0.trial114.stdout:191: writing trial11441570-45 from 3243812 to 3748579 tid 3 2026-02-20T13:06:15.556 INFO:tasks.rados.rados.0.trial114.stdout:192: snap_create 2026-02-20T13:06:15.556 INFO:tasks.rados.rados.0.trial114.stdout:189: finishing write tid 2 to trial11441570-44 2026-02-20T13:06:15.556 INFO:tasks.rados.rados.0.trial114.stdout:189: finishing write tid 3 to trial11441570-44 2026-02-20T13:06:15.556 INFO:tasks.rados.rados.0.trial114.stdout:189: finishing write tid 4 to trial11441570-44 2026-02-20T13:06:15.556 INFO:tasks.rados.rados.0.trial114.stdout:189: finishing write tid 5 to trial11441570-44 2026-02-20T13:06:15.556 INFO:tasks.rados.rados.0.trial114.stdout:189: oid 44 updating version 0 to 50 2026-02-20T13:06:15.557 INFO:tasks.rados.rados.0.trial114.stdout:189: oid 44 updating version 50 to 53 2026-02-20T13:06:15.557 INFO:tasks.rados.rados.0.trial114.stdout:189: oid 44 version 53 is already newer than 53 2026-02-20T13:06:15.557 INFO:tasks.rados.rados.0.trial114.stdout:189: oid 44 version 53 is already newer than 53 2026-02-20T13:06:15.557 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 53 (ObjNum 107 snap 18 seq_num 107) dirty exists 2026-02-20T13:06:15.557 INFO:tasks.rados.rados.0.trial114.stdout:189: left oid 44 (ObjNum 107 snap 18 seq_num 107) 2026-02-20T13:06:15.577 INFO:tasks.rados.rados.0.trial114.stdout:191: finishing write tid 1 to trial11441570-45 2026-02-20T13:06:15.591 INFO:tasks.rados.rados.0.trial114.stdout:191: finishing write tid 2 to trial11441570-45 2026-02-20T13:06:15.596 INFO:tasks.rados.rados.0.trial114.stdout:191: finishing write tid 3 to trial11441570-45 2026-02-20T13:06:15.600 INFO:tasks.rados.rados.0.trial114.stdout:191: finishing write tid 4 to trial11441570-45 2026-02-20T13:06:15.601 INFO:tasks.rados.rados.0.trial114.stdout:191: finishing write tid 5 to trial11441570-45 2026-02-20T13:06:15.602 INFO:tasks.rados.rados.0.trial114.stdout:191: oid 45 updating version 0 to 53 2026-02-20T13:06:15.602 INFO:tasks.rados.rados.0.trial114.stdout:191: oid 45 updating version 53 to 56 2026-02-20T13:06:15.602 INFO:tasks.rados.rados.0.trial114.stdout:191: oid 45 version 56 is already newer than 56 2026-02-20T13:06:15.602 INFO:tasks.rados.rados.0.trial114.stdout:191: oid 45 version 56 is already newer than 56 2026-02-20T13:06:15.602 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 45 v 56 (ObjNum 109 snap 18 seq_num 109) dirty exists 2026-02-20T13:06:15.602 INFO:tasks.rados.rados.0.trial114.stdout:191: left oid 45 (ObjNum 109 snap 18 seq_num 109) 2026-02-20T13:06:16.381 INFO:tasks.rados.rados.0.trial114.stdout:189: done (2 left) 2026-02-20T13:06:16.381 INFO:tasks.rados.rados.0.trial114.stdout:191: done (1 left) 2026-02-20T13:06:16.381 INFO:tasks.rados.rados.0.trial114.stdout:192: done (0 left) 2026-02-20T13:06:16.381 INFO:tasks.rados.rados.0.trial114.stdout:193: snap_create 2026-02-20T13:06:16.776 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:06:16.853 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:16.848+0000 7f993f45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:16.855 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:16.852+0000 7f993f45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:17.382 INFO:tasks.rados.rados.0.trial114.stdout:193: done (0 left) 2026-02-20T13:06:17.383 INFO:tasks.rados.rados.0.trial114.stdout:194: snap_remove snap 17 2026-02-20T13:06:17.778 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [3, 1, 0, 2] 2026-02-20T13:06:17.778 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:06:17.778 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [3, 1, 0, 2] 2026-02-20T13:06:17.778 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T13:06:17.778 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:06:17.841 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T13:06:18.387 INFO:tasks.rados.rados.0.trial114.stdout:194: done (0 left) 2026-02-20T13:06:18.387 INFO:tasks.rados.rados.0.trial114.stdout:195: write (excl) oid 9 current snap is 20 2026-02-20T13:06:18.387 INFO:tasks.rados.rados.0.trial114.stdout:195: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2026-02-20T13:06:18.392 INFO:tasks.rados.rados.0.trial114.stdout:195: writing trial11441570-9 from 648770 to 1355102 tid 1 2026-02-20T13:06:18.397 INFO:tasks.rados.rados.0.trial114.stdout:195: writing trial11441570-9 from 2120431 to 2540461 tid 2 2026-02-20T13:06:18.402 INFO:tasks.rados.rados.0.trial114.stdout:195: writing trial11441570-9 from 3271235 to 3703627 tid 3 2026-02-20T13:06:18.402 INFO:tasks.rados.rados.0.trial114.stdout:196: snap_create 2026-02-20T13:06:18.914 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:06:18.991 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:18.987+0000 7f0877cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:18.993 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:06:18.990+0000 7f0877cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:06:19.333 INFO:tasks.rados.rados.0.trial114.stdout:196: done (1 left) 2026-02-20T13:06:19.334 INFO:tasks.rados.rados.0.trial114.stdout:197: read oid 26 snap -1 2026-02-20T13:06:19.334 INFO:tasks.rados.rados.0.trial114.stdout:197: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:06:19.334 INFO:tasks.rados.rados.0.trial114.stdout:198: write (excl) oid 35 current snap is 21 2026-02-20T13:06:19.334 INFO:tasks.rados.rados.0.trial114.stdout:198: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2026-02-20T13:06:19.338 INFO:tasks.rados.rados.0.trial114.stdout:198: writing trial11441570-35 from 665577 to 1447158 tid 1 2026-02-20T13:06:19.343 INFO:tasks.rados.rados.0.trial114.stdout:198: writing trial11441570-35 from 2062560 to 2626248 tid 2 2026-02-20T13:06:19.348 INFO:tasks.rados.rados.0.trial114.stdout:198: writing trial11441570-35 from 3182305 to 3825969 tid 3 2026-02-20T13:06:19.348 INFO:tasks.rados.rados.0.trial114.stdout:199: delete oid 22 current snap is 21 2026-02-20T13:06:19.363 INFO:tasks.rados.rados.0.trial114.stdout:197: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:06:19.470 INFO:tasks.rados.rados.0.trial114.stdout:198: finishing write tid 1 to trial11441570-35 2026-02-20T13:06:19.470 INFO:tasks.rados.rados.0.trial114.stdout:198: finishing write tid 2 to trial11441570-35 2026-02-20T13:06:19.470 INFO:tasks.rados.rados.0.trial114.stdout:197: done (3 left) 2026-02-20T13:06:19.470 INFO:tasks.rados.rados.0.trial114.stdout:199: done (2 left) 2026-02-20T13:06:19.471 INFO:tasks.rados.rados.0.trial114.stdout:200: delete oid 18 current snap is 21 2026-02-20T13:06:19.471 INFO:tasks.rados.rados.0.trial114.stdout:198: finishing write tid 3 to trial11441570-35 2026-02-20T13:06:19.471 INFO:tasks.rados.rados.0.trial114.stdout:198: finishing write tid 4 to trial11441570-35 2026-02-20T13:06:19.471 INFO:tasks.rados.rados.0.trial114.stdout:198: finishing write tid 5 to trial11441570-35 2026-02-20T13:06:19.471 INFO:tasks.rados.rados.0.trial114.stdout:198: oid 35 updating version 0 to 58 2026-02-20T13:06:19.471 INFO:tasks.rados.rados.0.trial114.stdout:198: oid 35 version 58 is already newer than 55 2026-02-20T13:06:19.471 INFO:tasks.rados.rados.0.trial114.stdout:198: oid 35 version 58 is already newer than 58 2026-02-20T13:06:19.471 INFO:tasks.rados.rados.0.trial114.stdout:198: oid 35 version 58 is already newer than 58 2026-02-20T13:06:19.471 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 35 v 58 (ObjNum 111 snap 21 seq_num 111) dirty exists 2026-02-20T13:06:19.472 INFO:tasks.rados.rados.0.trial114.stdout:198: left oid 35 (ObjNum 111 snap 21 seq_num 111) 2026-02-20T13:06:22.842 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [3, 1, 0] 2026-02-20T13:06:22.842 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T13:06:22.842 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2026-02-20T13:06:22.842 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T13:06:22.843 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T13:06:22.846 INFO:tasks.ceph.osd.2:Started 2026-02-20T13:06:22.846 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:06:22.916 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:06:22.919 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:06:22.920 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:06:27.921 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:08:18.949 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T13:08:18.950 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:08:20.951 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:08:21.032 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:08:21.028+0000 7f8c85d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:08:21.034 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:08:21.031+0000 7f8c85d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:09:23.689 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception: exception: no data returned from admin socket 2026-02-20T13:09:23.693 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:09:23.694 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:09:24.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-20T13:09:28.695 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:09:28.772 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:09:28.775 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:09:28.776 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:09:30.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2026-02-20T13:09:33.776 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:09:33.848 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:09:33.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:09:33.852 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:09:35.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~11s 2026-02-20T13:09:38.852 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:09:38.923 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:09:38.926 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:09:38.926 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:09:41.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~17s 2026-02-20T13:09:43.927 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:09:43.998 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:09:44.000 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:09:44.000 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:09:46.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~22s 2026-02-20T13:09:49.001 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:09:49.072 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:09:49.075 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:09:49.075 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:09:50.408 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: osd down 2026-02-20T13:09:50.451 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:09:50.452 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:09:51.446 INFO:tasks.rados.rados.0.trial114.stdout:198: done (2 left) 2026-02-20T13:09:51.447 INFO:tasks.rados.rados.0.trial114.stdout:200: done (1 left) 2026-02-20T13:09:51.447 INFO:tasks.rados.rados.0.trial114.stdout:201: read oid 26 snap -1 2026-02-20T13:09:51.447 INFO:tasks.rados.rados.0.trial114.stdout:201: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:09:51.447 INFO:tasks.rados.rados.0.trial114.stdout:202: write (excl) oid 38 current snap is 21 2026-02-20T13:09:51.447 INFO:tasks.rados.rados.0.trial114.stdout:202: seq_num 114 ranges {715998=607328,1838006=427368,2864574=477480,3863835=52163} 2026-02-20T13:09:51.451 INFO:tasks.rados.rados.0.trial114.stdout:202: writing trial11441570-38 from 715998 to 1323326 tid 1 2026-02-20T13:09:51.455 INFO:tasks.rados.rados.0.trial114.stdout:202: writing trial11441570-38 from 1838006 to 2265374 tid 2 2026-02-20T13:09:51.459 INFO:tasks.rados.rados.0.trial114.stdout:202: writing trial11441570-38 from 2864574 to 3342054 tid 3 2026-02-20T13:09:51.462 INFO:tasks.rados.rados.0.trial114.stdout:202: writing trial11441570-38 from 3863835 to 3915998 tid 4 2026-02-20T13:09:51.462 INFO:tasks.rados.rados.0.trial114.stdout:203: write (excl) oid 35 current snap is 21 2026-02-20T13:09:51.462 INFO:tasks.rados.rados.0.trial114.stdout:203: seq_num 115 ranges {732805=798930,2296488=571026,3291997=405105} 2026-02-20T13:09:51.467 INFO:tasks.rados.rados.0.trial114.stdout:203: writing trial11441570-35 from 732805 to 1531735 tid 1 2026-02-20T13:09:51.472 INFO:tasks.rados.rados.0.trial114.stdout:203: writing trial11441570-35 from 2296488 to 2867514 tid 2 2026-02-20T13:09:51.476 INFO:tasks.rados.rados.0.trial114.stdout:203: writing trial11441570-35 from 3291997 to 3697102 tid 3 2026-02-20T13:09:51.476 INFO:tasks.rados.rados.0.trial114.stdout:204: snap_remove snap 18 2026-02-20T13:09:52.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~28s 2026-02-20T13:09:52.413 INFO:tasks.rados.rados.0.trial114.stdout:204: done (4 left) 2026-02-20T13:09:52.413 INFO:tasks.rados.rados.0.trial114.stdout:205: write (excl) oid 17 current snap is 21 2026-02-20T13:09:52.414 INFO:tasks.rados.rados.0.trial114.stdout:195: finishing write tid 1 to trial11441570-9 2026-02-20T13:09:52.414 INFO:tasks.rados.rados.0.trial114.stdout:205: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2026-02-20T13:09:52.418 INFO:tasks.rados.rados.0.trial114.stdout:205: writing trial11441570-17 from 749612 to 1223791 tid 1 2026-02-20T13:09:52.423 INFO:tasks.rados.rados.0.trial114.stdout:205: writing trial11441570-17 from 1954970 to 2386007 tid 2 2026-02-20T13:09:52.428 INFO:tasks.rados.rados.0.trial114.stdout:205: writing trial11441570-17 from 2919420 to 3535797 tid 3 2026-02-20T13:09:52.428 INFO:tasks.rados.rados.0.trial114.stdout:206: write oid 24 current snap is 21 2026-02-20T13:09:52.428 INFO:tasks.rados.rados.0.trial114.stdout:206: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2026-02-20T13:09:52.432 INFO:tasks.rados.rados.0.trial114.stdout:206: writing trial11441570-24 from 766419 to 1315847 tid 1 2026-02-20T13:09:52.437 INFO:tasks.rados.rados.0.trial114.stdout:206: writing trial11441570-24 from 2013452 to 2588147 tid 2 2026-02-20T13:09:52.442 INFO:tasks.rados.rados.0.trial114.stdout:206: writing trial11441570-24 from 3346843 to 3774492 tid 3 2026-02-20T13:09:52.443 INFO:tasks.rados.rados.0.trial114.stdout:207: snap_create 2026-02-20T13:09:52.443 INFO:tasks.rados.rados.0.trial114.stdout:202: finishing write tid 1 to trial11441570-38 2026-02-20T13:09:52.443 INFO:tasks.rados.rados.0.trial114.stdout:195: finishing write tid 2 to trial11441570-9 2026-02-20T13:09:52.443 INFO:tasks.rados.rados.0.trial114.stdout:201: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:09:52.448 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 965320 2026-02-20T13:09:52.453 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:09:52.512 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:09:52.535 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:09:52.530+0000 7fde859cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:09:52.537 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:09:52.534+0000 7fde859cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:09:52.549 INFO:tasks.rados.rados.0.trial114.stdout:195: finishing write tid 3 to trial11441570-9 2026-02-20T13:09:52.550 INFO:tasks.rados.rados.0.trial114.stdout:195: finishing write tid 4 to trial11441570-9 2026-02-20T13:09:52.550 INFO:tasks.rados.rados.0.trial114.stdout:195: finishing write tid 5 to trial11441570-9 2026-02-20T13:09:52.550 INFO:tasks.rados.rados.0.trial114.stdout:195: oid 9 updating version 0 to 61 2026-02-20T13:09:52.550 INFO:tasks.rados.rados.0.trial114.stdout:195: oid 9 updating version 61 to 64 2026-02-20T13:09:52.550 INFO:tasks.rados.rados.0.trial114.stdout:195: oid 9 version 64 is already newer than 64 2026-02-20T13:09:52.550 INFO:tasks.rados.rados.0.trial114.stdout:195: oid 9 version 64 is already newer than 64 2026-02-20T13:09:52.550 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 9 v 64 (ObjNum 110 snap 20 seq_num 110) dirty exists 2026-02-20T13:09:52.550 INFO:tasks.rados.rados.0.trial114.stdout:195: left oid 9 (ObjNum 110 snap 20 seq_num 110) 2026-02-20T13:09:52.550 INFO:tasks.rados.rados.0.trial114.stdout:202: finishing write tid 2 to trial11441570-38 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:202: finishing write tid 3 to trial11441570-38 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:202: finishing write tid 4 to trial11441570-38 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:202: finishing write tid 5 to trial11441570-38 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:202: finishing write tid 6 to trial11441570-38 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:202: oid 38 updating version 0 to 68 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:202: oid 38 version 68 is already newer than 64 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:202: oid 38 version 68 is already newer than 68 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:202: oid 38 version 68 is already newer than 68 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:202: oid 38 version 68 is already newer than 68 2026-02-20T13:09:52.551 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 38 v 68 (ObjNum 114 snap 21 seq_num 114) dirty exists 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:202: left oid 38 (ObjNum 114 snap 21 seq_num 114) 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: finishing write tid 1 to trial11441570-35 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: finishing write tid 2 to trial11441570-35 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: finishing write tid 3 to trial11441570-35 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: finishing write tid 4 to trial11441570-35 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: finishing write tid 5 to trial11441570-35 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: oid 35 updating version 0 to 62 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: oid 35 version 62 is already newer than 62 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: oid 35 version 62 is already newer than 62 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: oid 35 version 62 is already newer than 59 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 35 v 62 (ObjNum 115 snap 21 seq_num 115) dirty exists 2026-02-20T13:09:52.552 INFO:tasks.rados.rados.0.trial114.stdout:203: left oid 35 (ObjNum 115 snap 21 seq_num 115) 2026-02-20T13:09:52.553 INFO:tasks.rados.rados.0.trial114.stdout:206: finishing write tid 1 to trial11441570-24 2026-02-20T13:09:52.553 INFO:tasks.rados.rados.0.trial114.stdout:206: finishing write tid 2 to trial11441570-24 2026-02-20T13:09:52.553 INFO:tasks.rados.rados.0.trial114.stdout:206: finishing write tid 3 to trial11441570-24 2026-02-20T13:09:52.553 INFO:tasks.rados.rados.0.trial114.stdout:206: finishing write tid 4 to trial11441570-24 2026-02-20T13:09:52.553 INFO:tasks.rados.rados.0.trial114.stdout:206: finishing write tid 5 to trial11441570-24 2026-02-20T13:09:52.553 INFO:tasks.rados.rados.0.trial114.stdout:206: oid 24 updating version 0 to 63 2026-02-20T13:09:52.553 INFO:tasks.rados.rados.0.trial114.stdout:206: oid 24 version 63 is already newer than 63 2026-02-20T13:09:52.553 INFO:tasks.rados.rados.0.trial114.stdout:206: oid 24 version 63 is already newer than 63 2026-02-20T13:09:52.553 INFO:tasks.rados.rados.0.trial114.stdout:206: oid 24 version 63 is already newer than 63 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 24 v 63 (ObjNum 117 snap 21 seq_num 117) dirty exists 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:206: left oid 24 (ObjNum 117 snap 21 seq_num 117) 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:205: finishing write tid 1 to trial11441570-17 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:205: finishing write tid 2 to trial11441570-17 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:205: finishing write tid 3 to trial11441570-17 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:205: finishing write tid 4 to trial11441570-17 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:205: finishing write tid 5 to trial11441570-17 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:205: oid 17 updating version 0 to 18 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:205: oid 17 version 18 is already newer than 15 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:205: oid 17 version 18 is already newer than 18 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:205: oid 17 version 18 is already newer than 18 2026-02-20T13:09:52.554 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 17 v 18 (ObjNum 116 snap 21 seq_num 116) dirty exists 2026-02-20T13:09:52.555 INFO:tasks.rados.rados.0.trial114.stdout:205: left oid 17 (ObjNum 116 snap 21 seq_num 116) 2026-02-20T13:09:52.563 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:09:52.579 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:09:52.579 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:09:53.416 INFO:tasks.rados.rados.0.trial114.stdout:195: done (6 left) 2026-02-20T13:09:53.416 INFO:tasks.rados.rados.0.trial114.stdout:201: done (5 left) 2026-02-20T13:09:53.417 INFO:tasks.rados.rados.0.trial114.stdout:202: done (4 left) 2026-02-20T13:09:53.417 INFO:tasks.rados.rados.0.trial114.stdout:203: done (3 left) 2026-02-20T13:09:53.417 INFO:tasks.rados.rados.0.trial114.stdout:205: done (2 left) 2026-02-20T13:09:53.417 INFO:tasks.rados.rados.0.trial114.stdout:206: done (1 left) 2026-02-20T13:09:53.417 INFO:tasks.rados.rados.0.trial114.stdout:207: done (0 left) 2026-02-20T13:09:53.417 INFO:tasks.rados.rados.0.trial114.stdout:208: read oid 13 snap -1 2026-02-20T13:09:53.417 INFO:tasks.rados.rados.0.trial114.stdout:208: expect deleted 2026-02-20T13:09:53.417 INFO:tasks.rados.rados.0.trial114.stdout:209: delete oid 37 current snap is 22 2026-02-20T13:09:53.458 INFO:tasks.rados.rados.0.trial114.stdout:208: done (1 left) 2026-02-20T13:09:53.458 INFO:tasks.rados.rados.0.trial114.stdout:209: done (0 left) 2026-02-20T13:09:53.459 INFO:tasks.rados.rados.0.trial114.stdout:210: read oid 31 snap 19 2026-02-20T13:09:53.459 INFO:tasks.rados.rados.0.trial114.stdout:210: expect (ObjNum 60 snap 2 seq_num 60) 2026-02-20T13:09:53.459 INFO:tasks.rados.rados.0.trial114.stdout:211: read oid 10 snap -1 2026-02-20T13:09:53.459 INFO:tasks.rados.rados.0.trial114.stdout:211: expect deleted 2026-02-20T13:09:53.459 INFO:tasks.rados.rados.0.trial114.stdout:212: read oid 1 snap 19 2026-02-20T13:09:53.459 INFO:tasks.rados.rados.0.trial114.stdout:212: expect (ObjNum 0 snap 0 seq_num 0) 2026-02-20T13:09:53.459 INFO:tasks.rados.rados.0.trial114.stdout:213: write oid 25 current snap is 22 2026-02-20T13:09:53.459 INFO:tasks.rados.rados.0.trial114.stdout:213: seq_num 119 ranges {400033=699926,1614063=385970} 2026-02-20T13:09:53.462 INFO:tasks.rados.rados.0.trial114.stdout:213: writing trial11441570-25 from 400033 to 1099959 tid 1 2026-02-20T13:09:53.465 INFO:tasks.rados.rados.0.trial114.stdout:213: writing trial11441570-25 from 1614063 to 2000033 tid 2 2026-02-20T13:09:53.465 INFO:tasks.rados.rados.0.trial114.stdout:214: snap_create 2026-02-20T13:09:53.477 INFO:tasks.rados.rados.0.trial114.stdout:212: expect (ObjNum 0 snap 0 seq_num 0) 2026-02-20T13:09:53.479 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 986284 2026-02-20T13:09:53.491 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:09:53.508 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:09:53.525 INFO:tasks.rados.rados.0.trial114.stdout:210: expect (ObjNum 60 snap 2 seq_num 60) 2026-02-20T13:09:53.525 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:09:53.550 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:09:53.602 INFO:tasks.rados.rados.0.trial114.stdout:213: finishing write tid 1 to trial11441570-25 2026-02-20T13:09:53.602 INFO:tasks.rados.rados.0.trial114.stdout:213: finishing write tid 2 to trial11441570-25 2026-02-20T13:09:53.602 INFO:tasks.rados.rados.0.trial114.stdout:213: finishing write tid 3 to trial11441570-25 2026-02-20T13:09:53.603 INFO:tasks.rados.rados.0.trial114.stdout:213: finishing write tid 4 to trial11441570-25 2026-02-20T13:09:53.603 INFO:tasks.rados.rados.0.trial114.stdout:213: oid 25 updating version 0 to 29 2026-02-20T13:09:53.603 INFO:tasks.rados.rados.0.trial114.stdout:213: oid 25 version 29 is already newer than 29 2026-02-20T13:09:53.603 INFO:tasks.rados.rados.0.trial114.stdout:213: oid 25 version 29 is already newer than 29 2026-02-20T13:09:53.603 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 25 v 29 (ObjNum 119 snap 22 seq_num 119) dirty exists 2026-02-20T13:09:53.603 INFO:tasks.rados.rados.0.trial114.stdout:213: left oid 25 (ObjNum 119 snap 22 seq_num 119) 2026-02-20T13:09:54.076 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:09:54.149 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:09:54.152 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:09:54.152 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:09:54.420 INFO:tasks.rados.rados.0.trial114.stdout:210: done (4 left) 2026-02-20T13:09:54.420 INFO:tasks.rados.rados.0.trial114.stdout:211: done (3 left) 2026-02-20T13:09:54.420 INFO:tasks.rados.rados.0.trial114.stdout:212: done (2 left) 2026-02-20T13:09:54.420 INFO:tasks.rados.rados.0.trial114.stdout:213: done (1 left) 2026-02-20T13:09:54.421 INFO:tasks.rados.rados.0.trial114.stdout:214: done (0 left) 2026-02-20T13:09:54.421 INFO:tasks.rados.rados.0.trial114.stdout:215: read oid 24 snap 20 2026-02-20T13:09:54.421 INFO:tasks.rados.rados.0.trial114.stdout:215: expect (ObjNum 23 snap 0 seq_num 23) 2026-02-20T13:09:54.421 INFO:tasks.rados.rados.0.trial114.stdout:216: write (excl) oid 44 current snap is 23 2026-02-20T13:09:54.421 INFO:tasks.rados.rados.0.trial114.stdout:216: seq_num 120 ranges {416840=775175,1672545=344295} 2026-02-20T13:09:54.424 INFO:tasks.rados.rados.0.trial114.stdout:216: writing trial11441570-44 from 416840 to 1192015 tid 1 2026-02-20T13:09:54.427 INFO:tasks.rados.rados.0.trial114.stdout:216: writing trial11441570-44 from 1672545 to 2016840 tid 2 2026-02-20T13:09:54.427 INFO:tasks.rados.rados.0.trial114.stdout:217: snap_remove snap 22 2026-02-20T13:09:54.581 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:09:54.658 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:09:54.653+0000 7f533afdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:09:54.660 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:09:54.656+0000 7f533afdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:09:54.689 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:09:54.705 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:09:54.705 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:09:55.421 INFO:tasks.rados.rados.0.trial114.stdout:217: done (2 left) 2026-02-20T13:09:55.421 INFO:tasks.rados.rados.0.trial114.stdout:218: write oid 31 current snap is 23 2026-02-20T13:09:55.421 INFO:tasks.rados.rados.0.trial114.stdout:218: seq_num 121 ranges {433647=450424,1331027=582033} 2026-02-20T13:09:55.424 INFO:tasks.rados.rados.0.trial114.stdout:218: writing trial11441570-31 from 433647 to 884071 tid 1 2026-02-20T13:09:55.429 INFO:tasks.rados.rados.0.trial114.stdout:218: writing trial11441570-31 from 1331027 to 1913060 tid 2 2026-02-20T13:09:55.429 INFO:tasks.rados.rados.0.trial114.stdout:219: read oid 39 snap -1 2026-02-20T13:09:55.429 INFO:tasks.rados.rados.0.trial114.stdout:219: expect (ObjNum 71 snap 8 seq_num 71) 2026-02-20T13:09:55.429 INFO:tasks.rados.rados.0.trial114.stdout:220: read oid 28 snap -1 2026-02-20T13:09:55.429 INFO:tasks.rados.rados.0.trial114.stdout:220: expect deleted 2026-02-20T13:09:55.429 INFO:tasks.rados.rados.0.trial114.stdout:221: delete oid 3 current snap is 23 2026-02-20T13:09:55.429 INFO:tasks.rados.rados.0.trial114.stdout:215: expect (ObjNum 23 snap 0 seq_num 23) 2026-02-20T13:09:55.446 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:09:55.474 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2125094 2026-02-20T13:09:55.476 INFO:tasks.rados.rados.0.trial114.stdout:216: finishing write tid 1 to trial11441570-44 2026-02-20T13:09:55.477 INFO:tasks.rados.rados.0.trial114.stdout:216: finishing write tid 2 to trial11441570-44 2026-02-20T13:09:55.477 INFO:tasks.rados.rados.0.trial114.stdout:216: finishing write tid 3 to trial11441570-44 2026-02-20T13:09:55.477 INFO:tasks.rados.rados.0.trial114.stdout:216: finishing write tid 4 to trial11441570-44 2026-02-20T13:09:55.477 INFO:tasks.rados.rados.0.trial114.stdout:216: oid 44 updating version 0 to 70 2026-02-20T13:09:55.477 INFO:tasks.rados.rados.0.trial114.stdout:216: oid 44 version 70 is already newer than 70 2026-02-20T13:09:55.477 INFO:tasks.rados.rados.0.trial114.stdout:216: oid 44 version 70 is already newer than 68 2026-02-20T13:09:55.477 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 70 (ObjNum 120 snap 23 seq_num 120) dirty exists 2026-02-20T13:09:55.477 INFO:tasks.rados.rados.0.trial114.stdout:216: left oid 44 (ObjNum 120 snap 23 seq_num 120) 2026-02-20T13:09:55.477 INFO:tasks.rados.rados.0.trial114.stdout:219: expect (ObjNum 71 snap 8 seq_num 71) 2026-02-20T13:09:55.551 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:218: finishing write tid 1 to trial11441570-31 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:218: finishing write tid 2 to trial11441570-31 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:218: finishing write tid 3 to trial11441570-31 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:218: finishing write tid 4 to trial11441570-31 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:218: oid 31 updating version 0 to 54 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:218: oid 31 version 54 is already newer than 54 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:218: oid 31 version 54 is already newer than 54 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 31 v 54 (ObjNum 121 snap 23 seq_num 121) dirty exists 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:218: left oid 31 (ObjNum 121 snap 23 seq_num 121) 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:215: done (5 left) 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:216: done (4 left) 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:218: done (3 left) 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:219: done (2 left) 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:220: done (1 left) 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:221: done (0 left) 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:222: write oid 13 current snap is 23 2026-02-20T13:09:55.589 INFO:tasks.rados.rados.0.trial114.stdout:222: seq_num 123 ranges {467261=717275,1847991=219270} 2026-02-20T13:09:55.593 INFO:tasks.rados.rados.0.trial114.stdout:222: writing trial11441570-13 from 467261 to 1184536 tid 1 2026-02-20T13:09:55.596 INFO:tasks.rados.rados.0.trial114.stdout:222: writing trial11441570-13 from 1847991 to 2067261 tid 2 2026-02-20T13:09:55.596 INFO:tasks.rados.rados.0.trial114.stdout:223: snap_remove snap 20 2026-02-20T13:09:56.427 INFO:tasks.rados.rados.0.trial114.stdout:223: done (1 left) 2026-02-20T13:09:56.427 INFO:tasks.rados.rados.0.trial114.stdout:224: read oid 28 snap 19 2026-02-20T13:09:56.427 INFO:tasks.rados.rados.0.trial114.stdout:224: expect deleted 2026-02-20T13:09:56.427 INFO:tasks.rados.rados.0.trial114.stdout:225: snap_create 2026-02-20T13:09:56.428 INFO:tasks.rados.rados.0.trial114.stdout:222: finishing write tid 1 to trial11441570-13 2026-02-20T13:09:56.428 INFO:tasks.rados.rados.0.trial114.stdout:222: finishing write tid 2 to trial11441570-13 2026-02-20T13:09:56.428 INFO:tasks.rados.rados.0.trial114.stdout:222: finishing write tid 3 to trial11441570-13 2026-02-20T13:09:56.428 INFO:tasks.rados.rados.0.trial114.stdout:222: finishing write tid 4 to trial11441570-13 2026-02-20T13:09:56.428 INFO:tasks.rados.rados.0.trial114.stdout:222: oid 13 updating version 0 to 32 2026-02-20T13:09:56.428 INFO:tasks.rados.rados.0.trial114.stdout:222: oid 13 version 32 is already newer than 32 2026-02-20T13:09:56.428 INFO:tasks.rados.rados.0.trial114.stdout:222: oid 13 version 32 is already newer than 32 2026-02-20T13:09:56.428 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 13 v 32 (ObjNum 123 snap 23 seq_num 123) dirty exists 2026-02-20T13:09:56.428 INFO:tasks.rados.rados.0.trial114.stdout:222: left oid 13 (ObjNum 123 snap 23 seq_num 123) 2026-02-20T13:09:56.706 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:09:56.784 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:09:56.779+0000 7fee481c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:09:56.787 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:09:56.783+0000 7fee481c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:09:56.813 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:09:56.829 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:09:56.830 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:09:57.431 INFO:tasks.rados.rados.0.trial114.stdout:222: done (2 left) 2026-02-20T13:09:57.431 INFO:tasks.rados.rados.0.trial114.stdout:224: done (1 left) 2026-02-20T13:09:57.431 INFO:tasks.rados.rados.0.trial114.stdout:225: done (0 left) 2026-02-20T13:09:57.431 INFO:tasks.rados.rados.0.trial114.stdout:226: snap_remove snap 19 2026-02-20T13:09:57.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~33s 2026-02-20T13:09:58.432 INFO:tasks.rados.rados.0.trial114.stdout:226: done (0 left) 2026-02-20T13:09:58.432 INFO:tasks.rados.rados.0.trial114.stdout:227: snap_create 2026-02-20T13:09:58.831 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:09:58.908 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:09:58.903+0000 7f8892006640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:09:58.910 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:09:58.906+0000 7f8892006640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:09:58.936 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:09:58.951 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:09:58.952 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:09:59.153 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:09:59.224 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:09:59.227 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:09:59.228 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:09:59.358 INFO:tasks.rados.rados.0.trial114.stdout:227: done (0 left) 2026-02-20T13:09:59.358 INFO:tasks.rados.rados.0.trial114.stdout:228: read oid 34 snap -1 2026-02-20T13:09:59.359 INFO:tasks.rados.rados.0.trial114.stdout:228: expect (ObjNum 91 snap 16 seq_num 91) 2026-02-20T13:09:59.359 INFO:tasks.rados.rados.0.trial114.stdout:229: snap_remove snap 23 2026-02-20T13:10:00.362 INFO:tasks.rados.rados.0.trial114.stdout:229: done (1 left) 2026-02-20T13:10:00.362 INFO:tasks.rados.rados.0.trial114.stdout:230: read oid 43 snap -1 2026-02-20T13:10:00.362 INFO:tasks.rados.rados.0.trial114.stdout:230: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-20T13:10:00.362 INFO:tasks.rados.rados.0.trial114.stdout:231: snap_create 2026-02-20T13:10:00.362 INFO:tasks.rados.rados.0.trial114.stdout:228: expect (ObjNum 91 snap 16 seq_num 91) 2026-02-20T13:10:00.392 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 719172 2026-02-20T13:10:00.448 INFO:tasks.rados.rados.0.trial114.stdout:230: expect (ObjNum 42 snap 0 seq_num 42) 2026-02-20T13:10:00.448 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:00.494 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 457350 2026-02-20T13:10:00.953 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:01.031 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:01.027+0000 7f256276f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:01.033 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:01.030+0000 7f256276f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:01.060 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:01.077 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:01.077 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:01.364 INFO:tasks.rados.rados.0.trial114.stdout:228: done (2 left) 2026-02-20T13:10:01.364 INFO:tasks.rados.rados.0.trial114.stdout:230: done (1 left) 2026-02-20T13:10:01.364 INFO:tasks.rados.rados.0.trial114.stdout:231: done (0 left) 2026-02-20T13:10:01.364 INFO:tasks.rados.rados.0.trial114.stdout:232: write (excl) oid 32 current snap is 26 2026-02-20T13:10:01.364 INFO:tasks.rados.rados.0.trial114.stdout:232: seq_num 124 ranges {484068=792524,1906473=177595} 2026-02-20T13:10:01.368 INFO:tasks.rados.rados.0.trial114.stdout:232: writing trial11441570-32 from 484068 to 1276592 tid 1 2026-02-20T13:10:01.371 INFO:tasks.rados.rados.0.trial114.stdout:232: writing trial11441570-32 from 1906473 to 2084068 tid 2 2026-02-20T13:10:01.372 INFO:tasks.rados.rados.0.trial114.stdout:233: write (excl) oid 33 current snap is 26 2026-02-20T13:10:01.372 INFO:tasks.rados.rados.0.trial114.stdout:233: seq_num 125 ranges {500875=467773,1564955=535920} 2026-02-20T13:10:01.375 INFO:tasks.rados.rados.0.trial114.stdout:233: writing trial11441570-33 from 500875 to 968648 tid 1 2026-02-20T13:10:01.380 INFO:tasks.rados.rados.0.trial114.stdout:233: writing trial11441570-33 from 1564955 to 2100875 tid 2 2026-02-20T13:10:01.380 INFO:tasks.rados.rados.0.trial114.stdout:234: write oid 11 current snap is 26 2026-02-20T13:10:01.380 INFO:tasks.rados.rados.0.trial114.stdout:234: seq_num 126 ranges {517682=543022,1623437=494245} 2026-02-20T13:10:01.384 INFO:tasks.rados.rados.0.trial114.stdout:234: writing trial11441570-11 from 517682 to 1060704 tid 1 2026-02-20T13:10:01.388 INFO:tasks.rados.rados.0.trial114.stdout:234: writing trial11441570-11 from 1623437 to 2117682 tid 2 2026-02-20T13:10:01.388 INFO:tasks.rados.rados.0.trial114.stdout:235: snap_remove snap 25 2026-02-20T13:10:02.371 INFO:tasks.rados.rados.0.trial114.stdout:235: done (3 left) 2026-02-20T13:10:02.371 INFO:tasks.rados.rados.0.trial114.stdout:236: snap_create 2026-02-20T13:10:02.371 INFO:tasks.rados.rados.0.trial114.stdout:232: finishing write tid 1 to trial11441570-32 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:233: finishing write tid 1 to trial11441570-33 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:232: finishing write tid 2 to trial11441570-32 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:234: finishing write tid 1 to trial11441570-11 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:232: finishing write tid 3 to trial11441570-32 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:232: finishing write tid 4 to trial11441570-32 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:232: oid 32 updating version 0 to 82 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:232: oid 32 version 82 is already newer than 82 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:232: oid 32 version 82 is already newer than 80 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 32 v 82 (ObjNum 124 snap 26 seq_num 124) dirty exists 2026-02-20T13:10:02.372 INFO:tasks.rados.rados.0.trial114.stdout:232: left oid 32 (ObjNum 124 snap 26 seq_num 124) 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:234: finishing write tid 2 to trial11441570-11 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:233: finishing write tid 2 to trial11441570-33 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:234: finishing write tid 3 to trial11441570-11 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:234: finishing write tid 4 to trial11441570-11 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:234: oid 11 updating version 0 to 17 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:234: oid 11 version 17 is already newer than 17 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:234: oid 11 version 17 is already newer than 17 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 11 v 17 (ObjNum 126 snap 26 seq_num 126) dirty exists 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:234: left oid 11 (ObjNum 126 snap 26 seq_num 126) 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:233: finishing write tid 3 to trial11441570-33 2026-02-20T13:10:02.373 INFO:tasks.rados.rados.0.trial114.stdout:233: finishing write tid 4 to trial11441570-33 2026-02-20T13:10:02.374 INFO:tasks.rados.rados.0.trial114.stdout:233: oid 33 updating version 0 to 27 2026-02-20T13:10:02.374 INFO:tasks.rados.rados.0.trial114.stdout:233: oid 33 version 27 is already newer than 27 2026-02-20T13:10:02.374 INFO:tasks.rados.rados.0.trial114.stdout:233: oid 33 version 27 is already newer than 25 2026-02-20T13:10:02.374 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 33 v 27 (ObjNum 125 snap 26 seq_num 125) dirty exists 2026-02-20T13:10:02.374 INFO:tasks.rados.rados.0.trial114.stdout:233: left oid 33 (ObjNum 125 snap 26 seq_num 125) 2026-02-20T13:10:03.079 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:03.155 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:03.151+0000 7fee17c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:03.158 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:03.155+0000 7fee169d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:03.184 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:03.201 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:03.202 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:03.310 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~39s 2026-02-20T13:10:03.372 INFO:tasks.rados.rados.0.trial114.stdout:232: done (3 left) 2026-02-20T13:10:03.373 INFO:tasks.rados.rados.0.trial114.stdout:233: done (2 left) 2026-02-20T13:10:03.373 INFO:tasks.rados.rados.0.trial114.stdout:234: done (1 left) 2026-02-20T13:10:03.373 INFO:tasks.rados.rados.0.trial114.stdout:236: done (0 left) 2026-02-20T13:10:03.373 INFO:tasks.rados.rados.0.trial114.stdout:237: write (excl) oid 29 current snap is 27 2026-02-20T13:10:03.373 INFO:tasks.rados.rados.0.trial114.stdout:237: seq_num 127 ranges {534489=618271,1565566=568923} 2026-02-20T13:10:03.376 INFO:tasks.rados.rados.0.trial114.stdout:237: writing trial11441570-29 from 534489 to 1152760 tid 1 2026-02-20T13:10:03.380 INFO:tasks.rados.rados.0.trial114.stdout:237: writing trial11441570-29 from 1565566 to 2134489 tid 2 2026-02-20T13:10:03.380 INFO:tasks.rados.rados.0.trial114.stdout:238: snap_remove snap 24 2026-02-20T13:10:04.229 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:04.301 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:04.305 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:04.306 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:04.377 INFO:tasks.rados.rados.0.trial114.stdout:238: done (1 left) 2026-02-20T13:10:04.378 INFO:tasks.rados.rados.0.trial114.stdout:239: write (excl) oid 28 current snap is 27 2026-02-20T13:10:04.378 INFO:tasks.rados.rados.0.trial114.stdout:237: finishing write tid 1 to trial11441570-29 2026-02-20T13:10:04.378 INFO:tasks.rados.rados.0.trial114.stdout:239: seq_num 128 ranges {551296=693520,2024048=127248} 2026-02-20T13:10:04.382 INFO:tasks.rados.rados.0.trial114.stdout:239: writing trial11441570-28 from 551296 to 1244816 tid 1 2026-02-20T13:10:04.386 INFO:tasks.rados.rados.0.trial114.stdout:239: writing trial11441570-28 from 2024048 to 2151296 tid 2 2026-02-20T13:10:04.386 INFO:tasks.rados.rados.0.trial114.stdout:240: write oid 19 current snap is 27 2026-02-20T13:10:04.386 INFO:tasks.rados.rados.0.trial114.stdout:237: finishing write tid 2 to trial11441570-29 2026-02-20T13:10:04.386 INFO:tasks.rados.rados.0.trial114.stdout:240: seq_num 129 ranges {568103=768769,2082530=85573} 2026-02-20T13:10:04.391 INFO:tasks.rados.rados.0.trial114.stdout:240: writing trial11441570-19 from 568103 to 1336872 tid 1 2026-02-20T13:10:04.394 INFO:tasks.rados.rados.0.trial114.stdout:240: writing trial11441570-19 from 2082530 to 2168103 tid 2 2026-02-20T13:10:04.395 INFO:tasks.rados.rados.0.trial114.stdout:241: read oid 41 snap 21 2026-02-20T13:10:04.395 INFO:tasks.rados.rados.0.trial114.stdout:241: expect (ObjNum 67 snap 5 seq_num 67) 2026-02-20T13:10:04.395 INFO:tasks.rados.rados.0.trial114.stdout:242: read oid 20 snap -1 2026-02-20T13:10:04.395 INFO:tasks.rados.rados.0.trial114.stdout:242: expect (ObjNum 97 snap 16 seq_num 97) 2026-02-20T13:10:04.395 INFO:tasks.rados.rados.0.trial114.stdout:243: snap_remove snap 26 2026-02-20T13:10:05.203 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:05.279 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:05.275+0000 7f90ffbed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:05.281 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:05.278+0000 7f90ffbed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:05.309 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:05.325 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:05.326 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:05.379 INFO:tasks.rados.rados.0.trial114.stdout:243: done (5 left) 2026-02-20T13:10:05.379 INFO:tasks.rados.rados.0.trial114.stdout:244: write (excl) oid 22 current snap is 27 2026-02-20T13:10:05.379 INFO:tasks.rados.rados.0.trial114.stdout:237: finishing write tid 3 to trial11441570-29 2026-02-20T13:10:05.379 INFO:tasks.rados.rados.0.trial114.stdout:244: seq_num 130 ranges {584910=560371,1857365=327545} 2026-02-20T13:10:05.384 INFO:tasks.rados.rados.0.trial114.stdout:244: writing trial11441570-22 from 584910 to 1145281 tid 1 2026-02-20T13:10:05.389 INFO:tasks.rados.rados.0.trial114.stdout:244: writing trial11441570-22 from 1857365 to 2184910 tid 2 2026-02-20T13:10:05.389 INFO:tasks.rados.rados.0.trial114.stdout:245: snap_create 2026-02-20T13:10:05.389 INFO:tasks.rados.rados.0.trial114.stdout:237: finishing write tid 4 to trial11441570-29 2026-02-20T13:10:05.389 INFO:tasks.rados.rados.0.trial114.stdout:237: oid 29 updating version 0 to 67 2026-02-20T13:10:05.389 INFO:tasks.rados.rados.0.trial114.stdout:237: oid 29 version 67 is already newer than 65 2026-02-20T13:10:05.389 INFO:tasks.rados.rados.0.trial114.stdout:237: oid 29 version 67 is already newer than 67 2026-02-20T13:10:05.389 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 29 v 67 (ObjNum 127 snap 27 seq_num 127) dirty exists 2026-02-20T13:10:05.389 INFO:tasks.rados.rados.0.trial114.stdout:237: left oid 29 (ObjNum 127 snap 27 seq_num 127) 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:240: finishing write tid 1 to trial11441570-19 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:239: finishing write tid 1 to trial11441570-28 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:240: finishing write tid 2 to trial11441570-19 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:240: finishing write tid 3 to trial11441570-19 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:240: finishing write tid 4 to trial11441570-19 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:240: oid 19 updating version 0 to 70 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:240: oid 19 version 70 is already newer than 70 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:240: oid 19 version 70 is already newer than 70 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 19 v 70 (ObjNum 129 snap 27 seq_num 129) dirty exists 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:240: left oid 19 (ObjNum 129 snap 27 seq_num 129) 2026-02-20T13:10:05.390 INFO:tasks.rados.rados.0.trial114.stdout:242: expect (ObjNum 97 snap 16 seq_num 97) 2026-02-20T13:10:05.453 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 3584405 2026-02-20T13:10:05.499 INFO:tasks.rados.rados.0.trial114.stdout:239: finishing write tid 2 to trial11441570-28 2026-02-20T13:10:05.499 INFO:tasks.rados.rados.0.trial114.stdout:239: finishing write tid 3 to trial11441570-28 2026-02-20T13:10:05.499 INFO:tasks.rados.rados.0.trial114.stdout:239: finishing write tid 4 to trial11441570-28 2026-02-20T13:10:05.499 INFO:tasks.rados.rados.0.trial114.stdout:239: oid 28 updating version 0 to 69 2026-02-20T13:10:05.499 INFO:tasks.rados.rados.0.trial114.stdout:239: oid 28 updating version 69 to 71 2026-02-20T13:10:05.500 INFO:tasks.rados.rados.0.trial114.stdout:239: oid 28 version 71 is already newer than 71 2026-02-20T13:10:05.500 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 28 v 71 (ObjNum 128 snap 27 seq_num 128) dirty exists 2026-02-20T13:10:05.500 INFO:tasks.rados.rados.0.trial114.stdout:239: left oid 28 (ObjNum 128 snap 27 seq_num 128) 2026-02-20T13:10:05.500 INFO:tasks.rados.rados.0.trial114.stdout:241: expect (ObjNum 67 snap 5 seq_num 67) 2026-02-20T13:10:05.536 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:05.586 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2582639 2026-02-20T13:10:05.598 INFO:tasks.rados.rados.0.trial114.stdout:244: finishing write tid 1 to trial11441570-22 2026-02-20T13:10:05.598 INFO:tasks.rados.rados.0.trial114.stdout:244: finishing write tid 2 to trial11441570-22 2026-02-20T13:10:05.599 INFO:tasks.rados.rados.0.trial114.stdout:244: finishing write tid 3 to trial11441570-22 2026-02-20T13:10:05.599 INFO:tasks.rados.rados.0.trial114.stdout:244: finishing write tid 4 to trial11441570-22 2026-02-20T13:10:05.599 INFO:tasks.rados.rados.0.trial114.stdout:244: oid 22 updating version 0 to 43 2026-02-20T13:10:05.599 INFO:tasks.rados.rados.0.trial114.stdout:244: oid 22 version 43 is already newer than 41 2026-02-20T13:10:05.599 INFO:tasks.rados.rados.0.trial114.stdout:244: oid 22 version 43 is already newer than 43 2026-02-20T13:10:05.599 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 22 v 43 (ObjNum 130 snap 27 seq_num 130) dirty exists 2026-02-20T13:10:05.599 INFO:tasks.rados.rados.0.trial114.stdout:244: left oid 22 (ObjNum 130 snap 27 seq_num 130) 2026-02-20T13:10:06.384 INFO:tasks.rados.rados.0.trial114.stdout:237: done (6 left) 2026-02-20T13:10:06.384 INFO:tasks.rados.rados.0.trial114.stdout:239: done (5 left) 2026-02-20T13:10:06.384 INFO:tasks.rados.rados.0.trial114.stdout:240: done (4 left) 2026-02-20T13:10:06.384 INFO:tasks.rados.rados.0.trial114.stdout:241: done (3 left) 2026-02-20T13:10:06.385 INFO:tasks.rados.rados.0.trial114.stdout:242: done (2 left) 2026-02-20T13:10:06.385 INFO:tasks.rados.rados.0.trial114.stdout:244: done (1 left) 2026-02-20T13:10:06.385 INFO:tasks.rados.rados.0.trial114.stdout:245: done (0 left) 2026-02-20T13:10:06.385 INFO:tasks.rados.rados.0.trial114.stdout:246: read oid 24 snap 27 2026-02-20T13:10:06.385 INFO:tasks.rados.rados.0.trial114.stdout:246: expect (ObjNum 117 snap 21 seq_num 117) 2026-02-20T13:10:06.385 INFO:tasks.rados.rados.0.trial114.stdout:247: snap_create 2026-02-20T13:10:06.411 INFO:tasks.rados.rados.0.trial114.stdout:246: expect (ObjNum 117 snap 21 seq_num 117) 2026-02-20T13:10:06.447 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:06.494 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:07.327 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:07.386 INFO:tasks.rados.rados.0.trial114.stdout:246: done (1 left) 2026-02-20T13:10:07.386 INFO:tasks.rados.rados.0.trial114.stdout:247: done (0 left) 2026-02-20T13:10:07.386 INFO:tasks.rados.rados.0.trial114.stdout:248: write (excl) oid 13 current snap is 29 2026-02-20T13:10:07.386 INFO:tasks.rados.rados.0.trial114.stdout:248: seq_num 131 ranges {601717=635620,1799494=402223} 2026-02-20T13:10:07.391 INFO:tasks.rados.rados.0.trial114.stdout:248: writing trial11441570-13 from 601717 to 1237337 tid 1 2026-02-20T13:10:07.394 INFO:tasks.rados.rados.0.trial114.stdout:248: writing trial11441570-13 from 1799494 to 2201717 tid 2 2026-02-20T13:10:07.394 INFO:tasks.rados.rados.0.trial114.stdout:249: snap_create 2026-02-20T13:10:07.410 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:07.407+0000 7fbb3d251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:07.413 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:07.411+0000 7fbb3d251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:07.422 INFO:tasks.rados.rados.0.trial114.stdout:248: finishing write tid 1 to trial11441570-13 2026-02-20T13:10:07.437 INFO:tasks.rados.rados.0.trial114.stdout:248: finishing write tid 2 to trial11441570-13 2026-02-20T13:10:07.438 INFO:tasks.rados.rados.0.trial114.stdout:248: finishing write tid 3 to trial11441570-13 2026-02-20T13:10:07.440 INFO:tasks.rados.rados.0.trial114.stdout:248: finishing write tid 4 to trial11441570-13 2026-02-20T13:10:07.440 INFO:tasks.rados.rados.0.trial114.stdout:248: oid 13 updating version 0 to 47 2026-02-20T13:10:07.440 INFO:tasks.rados.rados.0.trial114.stdout:248: oid 13 version 47 is already newer than 47 2026-02-20T13:10:07.440 INFO:tasks.rados.rados.0.trial114.stdout:248: oid 13 version 47 is already newer than 45 2026-02-20T13:10:07.440 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 13 v 47 (ObjNum 131 snap 29 seq_num 131) dirty exists 2026-02-20T13:10:07.440 INFO:tasks.rados.rados.0.trial114.stdout:248: left oid 13 (ObjNum 131 snap 29 seq_num 131) 2026-02-20T13:10:07.452 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:07.476 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:07.477 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:08.392 INFO:tasks.rados.rados.0.trial114.stdout:248: done (1 left) 2026-02-20T13:10:08.392 INFO:tasks.rados.rados.0.trial114.stdout:249: done (0 left) 2026-02-20T13:10:08.392 INFO:tasks.rados.rados.0.trial114.stdout:250: read oid 49 snap -1 2026-02-20T13:10:08.392 INFO:tasks.rados.rados.0.trial114.stdout:250: expect (ObjNum 104 snap 17 seq_num 104) 2026-02-20T13:10:08.392 INFO:tasks.rados.rados.0.trial114.stdout:251: read oid 9 snap -1 2026-02-20T13:10:08.392 INFO:tasks.rados.rados.0.trial114.stdout:251: expect (ObjNum 110 snap 20 seq_num 110) 2026-02-20T13:10:08.392 INFO:tasks.rados.rados.0.trial114.stdout:252: snap_remove snap 28 2026-02-20T13:10:08.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~44s 2026-02-20T13:10:09.306 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:09.362 INFO:tasks.rados.rados.0.trial114.stdout:252: done (2 left) 2026-02-20T13:10:09.362 INFO:tasks.rados.rados.0.trial114.stdout:253: delete oid 33 current snap is 30 2026-02-20T13:10:09.362 INFO:tasks.rados.rados.0.trial114.stdout:251: expect (ObjNum 110 snap 20 seq_num 110) 2026-02-20T13:10:09.362 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:09.380 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:09.383 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:09.383 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:09.457 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1001849 2026-02-20T13:10:09.478 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:09.493 INFO:tasks.rados.rados.0.trial114.stdout:250: expect (ObjNum 104 snap 17 seq_num 104) 2026-02-20T13:10:09.493 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:09.525 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:09.553 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:09.550+0000 7f949641a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:09.556 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:09.554+0000 7f949641a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:09.567 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 3250245 2026-02-20T13:10:09.574 INFO:tasks.rados.rados.0.trial114.stdout:250: done (2 left) 2026-02-20T13:10:09.574 INFO:tasks.rados.rados.0.trial114.stdout:251: done (1 left) 2026-02-20T13:10:09.574 INFO:tasks.rados.rados.0.trial114.stdout:253: done (0 left) 2026-02-20T13:10:09.574 INFO:tasks.rados.rados.0.trial114.stdout:254: write (excl) oid 24 current snap is 30 2026-02-20T13:10:09.574 INFO:tasks.rados.rados.0.trial114.stdout:254: seq_num 133 ranges {635331=786118,1916458=318873} 2026-02-20T13:10:09.579 INFO:tasks.rados.rados.0.trial114.stdout:254: writing trial11441570-24 from 635331 to 1421449 tid 1 2026-02-20T13:10:09.582 INFO:tasks.rados.rados.0.trial114.stdout:254: writing trial11441570-24 from 1916458 to 2235331 tid 2 2026-02-20T13:10:09.583 INFO:tasks.rados.rados.0.trial114.stdout:255: read oid 7 snap -1 2026-02-20T13:10:09.583 INFO:tasks.rados.rados.0.trial114.stdout:255: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:10:09.583 INFO:tasks.rados.rados.0.trial114.stdout:256: read oid 45 snap -1 2026-02-20T13:10:09.583 INFO:tasks.rados.rados.0.trial114.stdout:256: expect (ObjNum 109 snap 18 seq_num 109) 2026-02-20T13:10:09.583 INFO:tasks.rados.rados.0.trial114.stdout:257: snap_remove snap 29 2026-02-20T13:10:09.583 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:09.617 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:09.617 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:10.397 INFO:tasks.rados.rados.0.trial114.stdout:257: done (3 left) 2026-02-20T13:10:10.397 INFO:tasks.rados.rados.0.trial114.stdout:258: delete oid 36 current snap is 30 2026-02-20T13:10:10.397 INFO:tasks.rados.rados.0.trial114.stdout:254: finishing write tid 1 to trial11441570-24 2026-02-20T13:10:10.397 INFO:tasks.rados.rados.0.trial114.stdout:254: finishing write tid 2 to trial11441570-24 2026-02-20T13:10:10.397 INFO:tasks.rados.rados.0.trial114.stdout:254: finishing write tid 3 to trial11441570-24 2026-02-20T13:10:10.397 INFO:tasks.rados.rados.0.trial114.stdout:255: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:10:10.397 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:10.416 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:10.436 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1242326 2026-02-20T13:10:10.447 INFO:tasks.rados.rados.0.trial114.stdout:254: finishing write tid 4 to trial11441570-24 2026-02-20T13:10:10.447 INFO:tasks.rados.rados.0.trial114.stdout:254: oid 24 updating version 0 to 71 2026-02-20T13:10:10.447 INFO:tasks.rados.rados.0.trial114.stdout:254: oid 24 version 71 is already newer than 69 2026-02-20T13:10:10.447 INFO:tasks.rados.rados.0.trial114.stdout:254: oid 24 version 71 is already newer than 71 2026-02-20T13:10:10.447 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 24 v 71 (ObjNum 133 snap 30 seq_num 133) dirty exists 2026-02-20T13:10:10.447 INFO:tasks.rados.rados.0.trial114.stdout:254: left oid 24 (ObjNum 133 snap 30 seq_num 133) 2026-02-20T13:10:10.447 INFO:tasks.rados.rados.0.trial114.stdout:256: expect (ObjNum 109 snap 18 seq_num 109) 2026-02-20T13:10:10.643 INFO:tasks.rados.rados.0.trial114.stdout:254: done (3 left) 2026-02-20T13:10:10.643 INFO:tasks.rados.rados.0.trial114.stdout:255: done (2 left) 2026-02-20T13:10:10.643 INFO:tasks.rados.rados.0.trial114.stdout:256: done (1 left) 2026-02-20T13:10:10.643 INFO:tasks.rados.rados.0.trial114.stdout:258: done (0 left) 2026-02-20T13:10:10.643 INFO:tasks.rados.rados.0.trial114.stdout:259: snap_create 2026-02-20T13:10:11.397 INFO:tasks.rados.rados.0.trial114.stdout:259: done (0 left) 2026-02-20T13:10:11.398 INFO:tasks.rados.rados.0.trial114.stdout:260: snap_create 2026-02-20T13:10:11.618 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:11.693 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:11.689+0000 7fad2a70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:11.695 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:11.692+0000 7fad2a70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:11.722 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:11.738 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:11.739 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:12.401 INFO:tasks.rados.rados.0.trial114.stdout:260: done (0 left) 2026-02-20T13:10:12.401 INFO:tasks.rados.rados.0.trial114.stdout:261: snap_remove snap 27 2026-02-20T13:10:13.405 INFO:tasks.rados.rados.0.trial114.stdout:261: done (0 left) 2026-02-20T13:10:13.405 INFO:tasks.rados.rados.0.trial114.stdout:262: snap_create 2026-02-20T13:10:13.740 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:13.815 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:13.812+0000 7fa6aae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:13.818 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:13.815+0000 7fa6aae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:13.844 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:13.861 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:13.862 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:14.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2026-02-20T13:10:14.385 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:14.410 INFO:tasks.rados.rados.0.trial114.stdout:262: done (0 left) 2026-02-20T13:10:14.410 INFO:tasks.rados.rados.0.trial114.stdout:263: write (excl) oid 4 current snap is 33 2026-02-20T13:10:14.410 INFO:tasks.rados.rados.0.trial114.stdout:263: seq_num 135 ranges {668945=536616,1633422=491363} 2026-02-20T13:10:14.414 INFO:tasks.rados.rados.0.trial114.stdout:263: writing trial11441570-4 from 668945 to 1205561 tid 1 2026-02-20T13:10:14.418 INFO:tasks.rados.rados.0.trial114.stdout:263: writing trial11441570-4 from 1633422 to 2124785 tid 2 2026-02-20T13:10:14.418 INFO:tasks.rados.rados.0.trial114.stdout:264: write (excl) oid 22 current snap is 33 2026-02-20T13:10:14.418 INFO:tasks.rados.rados.0.trial114.stdout:264: seq_num 136 ranges {685752=611865,1975551=310201} 2026-02-20T13:10:14.423 INFO:tasks.rados.rados.0.trial114.stdout:264: writing trial11441570-22 from 685752 to 1297617 tid 1 2026-02-20T13:10:14.427 INFO:tasks.rados.rados.0.trial114.stdout:264: writing trial11441570-22 from 1975551 to 2285752 tid 2 2026-02-20T13:10:14.427 INFO:tasks.rados.rados.0.trial114.stdout:265: write oid 34 current snap is 33 2026-02-20T13:10:14.427 INFO:tasks.rados.rados.0.trial114.stdout:265: seq_num 137 ranges {702559=403467,1750386=495032} 2026-02-20T13:10:14.431 INFO:tasks.rados.rados.0.trial114.stdout:265: writing trial11441570-34 from 702559 to 1106026 tid 1 2026-02-20T13:10:14.435 INFO:tasks.rados.rados.0.trial114.stdout:265: writing trial11441570-34 from 1750386 to 2245418 tid 2 2026-02-20T13:10:14.436 INFO:tasks.rados.rados.0.trial114.stdout:266: write oid 15 current snap is 33 2026-02-20T13:10:14.436 INFO:tasks.rados.rados.0.trial114.stdout:266: seq_num 138 ranges {719366=478716,1808868=510498} 2026-02-20T13:10:14.440 INFO:tasks.rados.rados.0.trial114.stdout:266: writing trial11441570-15 from 719366 to 1198082 tid 1 2026-02-20T13:10:14.444 INFO:tasks.rados.rados.0.trial114.stdout:266: writing trial11441570-15 from 1808868 to 2319366 tid 2 2026-02-20T13:10:14.445 INFO:tasks.rados.rados.0.trial114.stdout:267: read oid 10 snap 31 2026-02-20T13:10:14.445 INFO:tasks.rados.rados.0.trial114.stdout:267: expect deleted 2026-02-20T13:10:14.445 INFO:tasks.rados.rados.0.trial114.stdout:268: write oid 30 current snap is 33 2026-02-20T13:10:14.445 INFO:tasks.rados.rados.0.trial114.stdout:268: seq_num 139 ranges {736173=553965,1867350=468823} 2026-02-20T13:10:14.449 INFO:tasks.rados.rados.0.trial114.stdout:268: writing trial11441570-30 from 736173 to 1290138 tid 1 2026-02-20T13:10:14.453 INFO:tasks.rados.rados.0.trial114.stdout:268: writing trial11441570-30 from 1867350 to 2336173 tid 2 2026-02-20T13:10:14.453 INFO:tasks.rados.rados.0.trial114.stdout:269: delete oid 44 current snap is 33 2026-02-20T13:10:14.459 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:14.460 INFO:tasks.rados.rados.0.trial114.stdout:263: finishing write tid 1 to trial11441570-4 2026-02-20T13:10:14.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:14.462 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:14.476 INFO:tasks.rados.rados.0.trial114.stdout:265: finishing write tid 1 to trial11441570-34 2026-02-20T13:10:14.480 INFO:tasks.rados.rados.0.trial114.stdout:263: finishing write tid 2 to trial11441570-4 2026-02-20T13:10:14.483 INFO:tasks.rados.rados.0.trial114.stdout:265: finishing write tid 2 to trial11441570-34 2026-02-20T13:10:14.490 INFO:tasks.rados.rados.0.trial114.stdout:263: finishing write tid 3 to trial11441570-4 2026-02-20T13:10:14.490 INFO:tasks.rados.rados.0.trial114.stdout:265: finishing write tid 3 to trial11441570-34 2026-02-20T13:10:14.490 INFO:tasks.rados.rados.0.trial114.stdout:267: done (6 left) 2026-02-20T13:10:14.490 INFO:tasks.rados.rados.0.trial114.stdout:269: done (5 left) 2026-02-20T13:10:14.491 INFO:tasks.rados.rados.0.trial114.stdout:270: write (excl) oid 45 current snap is 33 2026-02-20T13:10:14.491 INFO:tasks.rados.rados.0.trial114.stdout:270: seq_num 141 ranges {769787=704463,2267961=101826} 2026-02-20T13:10:14.496 INFO:tasks.rados.rados.0.trial114.stdout:270: writing trial11441570-45 from 769787 to 1474250 tid 1 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:270: writing trial11441570-45 from 2267961 to 2369787 tid 2 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:271: snap_create 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:265: finishing write tid 4 to trial11441570-34 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:265: oid 34 updating version 0 to 59 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:265: oid 34 version 59 is already newer than 59 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:265: oid 34 version 59 is already newer than 59 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 34 v 59 (ObjNum 137 snap 33 seq_num 137) dirty exists 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:265: left oid 34 (ObjNum 137 snap 33 seq_num 137) 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:263: finishing write tid 4 to trial11441570-4 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:263: oid 4 updating version 0 to 16 2026-02-20T13:10:14.500 INFO:tasks.rados.rados.0.trial114.stdout:263: oid 4 updating version 16 to 18 2026-02-20T13:10:14.501 INFO:tasks.rados.rados.0.trial114.stdout:263: oid 4 version 18 is already newer than 18 2026-02-20T13:10:14.501 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 4 v 18 (ObjNum 135 snap 33 seq_num 135) dirty exists 2026-02-20T13:10:14.501 INFO:tasks.rados.rados.0.trial114.stdout:263: left oid 4 (ObjNum 135 snap 33 seq_num 135) 2026-02-20T13:10:14.503 INFO:tasks.rados.rados.0.trial114.stdout:266: finishing write tid 1 to trial11441570-15 2026-02-20T13:10:14.508 INFO:tasks.rados.rados.0.trial114.stdout:264: finishing write tid 1 to trial11441570-22 2026-02-20T13:10:14.528 INFO:tasks.rados.rados.0.trial114.stdout:266: finishing write tid 2 to trial11441570-15 2026-02-20T13:10:14.538 INFO:tasks.rados.rados.0.trial114.stdout:266: finishing write tid 3 to trial11441570-15 2026-02-20T13:10:14.542 INFO:tasks.rados.rados.0.trial114.stdout:266: finishing write tid 4 to trial11441570-15 2026-02-20T13:10:14.543 INFO:tasks.rados.rados.0.trial114.stdout:266: oid 15 updating version 0 to 25 2026-02-20T13:10:14.543 INFO:tasks.rados.rados.0.trial114.stdout:266: oid 15 version 25 is already newer than 25 2026-02-20T13:10:14.543 INFO:tasks.rados.rados.0.trial114.stdout:266: oid 15 version 25 is already newer than 25 2026-02-20T13:10:14.543 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 15 v 25 (ObjNum 138 snap 33 seq_num 138) dirty exists 2026-02-20T13:10:14.543 INFO:tasks.rados.rados.0.trial114.stdout:266: left oid 15 (ObjNum 138 snap 33 seq_num 138) 2026-02-20T13:10:14.549 INFO:tasks.rados.rados.0.trial114.stdout:264: finishing write tid 2 to trial11441570-22 2026-02-20T13:10:14.556 INFO:tasks.rados.rados.0.trial114.stdout:264: finishing write tid 3 to trial11441570-22 2026-02-20T13:10:14.559 INFO:tasks.rados.rados.0.trial114.stdout:264: finishing write tid 4 to trial11441570-22 2026-02-20T13:10:14.559 INFO:tasks.rados.rados.0.trial114.stdout:264: oid 22 updating version 0 to 53 2026-02-20T13:10:14.559 INFO:tasks.rados.rados.0.trial114.stdout:264: oid 22 updating version 53 to 55 2026-02-20T13:10:14.560 INFO:tasks.rados.rados.0.trial114.stdout:264: oid 22 version 55 is already newer than 55 2026-02-20T13:10:14.560 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 22 v 55 (ObjNum 136 snap 33 seq_num 136) dirty exists 2026-02-20T13:10:14.560 INFO:tasks.rados.rados.0.trial114.stdout:264: left oid 22 (ObjNum 136 snap 33 seq_num 136) 2026-02-20T13:10:14.572 INFO:tasks.rados.rados.0.trial114.stdout:268: finishing write tid 1 to trial11441570-30 2026-02-20T13:10:14.578 INFO:tasks.rados.rados.0.trial114.stdout:268: finishing write tid 2 to trial11441570-30 2026-02-20T13:10:14.584 INFO:tasks.rados.rados.0.trial114.stdout:268: finishing write tid 3 to trial11441570-30 2026-02-20T13:10:14.586 INFO:tasks.rados.rados.0.trial114.stdout:268: finishing write tid 4 to trial11441570-30 2026-02-20T13:10:14.586 INFO:tasks.rados.rados.0.trial114.stdout:268: oid 30 updating version 0 to 79 2026-02-20T13:10:14.586 INFO:tasks.rados.rados.0.trial114.stdout:268: oid 30 version 79 is already newer than 79 2026-02-20T13:10:14.586 INFO:tasks.rados.rados.0.trial114.stdout:268: oid 30 version 79 is already newer than 79 2026-02-20T13:10:14.586 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 30 v 79 (ObjNum 139 snap 33 seq_num 139) dirty exists 2026-02-20T13:10:14.586 INFO:tasks.rados.rados.0.trial114.stdout:268: left oid 30 (ObjNum 139 snap 33 seq_num 139) 2026-02-20T13:10:14.599 INFO:tasks.rados.rados.0.trial114.stdout:270: finishing write tid 1 to trial11441570-45 2026-02-20T13:10:14.610 INFO:tasks.rados.rados.0.trial114.stdout:270: finishing write tid 2 to trial11441570-45 2026-02-20T13:10:14.616 INFO:tasks.rados.rados.0.trial114.stdout:270: finishing write tid 3 to trial11441570-45 2026-02-20T13:10:14.618 INFO:tasks.rados.rados.0.trial114.stdout:270: finishing write tid 4 to trial11441570-45 2026-02-20T13:10:14.618 INFO:tasks.rados.rados.0.trial114.stdout:270: oid 45 updating version 0 to 83 2026-02-20T13:10:14.618 INFO:tasks.rados.rados.0.trial114.stdout:270: oid 45 version 83 is already newer than 83 2026-02-20T13:10:14.618 INFO:tasks.rados.rados.0.trial114.stdout:270: oid 45 version 83 is already newer than 81 2026-02-20T13:10:14.618 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 45 v 83 (ObjNum 141 snap 33 seq_num 141) dirty exists 2026-02-20T13:10:14.618 INFO:tasks.rados.rados.0.trial114.stdout:270: left oid 45 (ObjNum 141 snap 33 seq_num 141) 2026-02-20T13:10:15.412 INFO:tasks.rados.rados.0.trial114.stdout:263: done (6 left) 2026-02-20T13:10:15.412 INFO:tasks.rados.rados.0.trial114.stdout:264: done (5 left) 2026-02-20T13:10:15.412 INFO:tasks.rados.rados.0.trial114.stdout:265: done (4 left) 2026-02-20T13:10:15.412 INFO:tasks.rados.rados.0.trial114.stdout:266: done (3 left) 2026-02-20T13:10:15.412 INFO:tasks.rados.rados.0.trial114.stdout:268: done (2 left) 2026-02-20T13:10:15.412 INFO:tasks.rados.rados.0.trial114.stdout:270: done (1 left) 2026-02-20T13:10:15.412 INFO:tasks.rados.rados.0.trial114.stdout:271: done (0 left) 2026-02-20T13:10:15.412 INFO:tasks.rados.rados.0.trial114.stdout:272: write oid 33 current snap is 34 2026-02-20T13:10:15.412 INFO:tasks.rados.rados.0.trial114.stdout:272: seq_num 142 ranges {786594=779712,2326443=60151} 2026-02-20T13:10:15.418 INFO:tasks.rados.rados.0.trial114.stdout:272: writing trial11441570-33 from 786594 to 1566306 tid 1 2026-02-20T13:10:15.421 INFO:tasks.rados.rados.0.trial114.stdout:272: writing trial11441570-33 from 2326443 to 2386594 tid 2 2026-02-20T13:10:15.421 INFO:tasks.rados.rados.0.trial114.stdout:273: read oid 5 snap -1 2026-02-20T13:10:15.421 INFO:tasks.rados.rados.0.trial114.stdout:273: expect deleted 2026-02-20T13:10:15.421 INFO:tasks.rados.rados.0.trial114.stdout:274: write oid 39 current snap is 34 2026-02-20T13:10:15.421 INFO:tasks.rados.rados.0.trial114.stdout:274: seq_num 143 ranges {403401=454961,1584925=506039} 2026-02-20T13:10:15.425 INFO:tasks.rados.rados.0.trial114.stdout:274: writing trial11441570-39 from 403401 to 858362 tid 1 2026-02-20T13:10:15.430 INFO:tasks.rados.rados.0.trial114.stdout:274: writing trial11441570-39 from 1584925 to 2090964 tid 2 2026-02-20T13:10:15.430 INFO:tasks.rados.rados.0.trial114.stdout:275: read oid 37 snap -1 2026-02-20T13:10:15.430 INFO:tasks.rados.rados.0.trial114.stdout:275: expect deleted 2026-02-20T13:10:15.430 INFO:tasks.rados.rados.0.trial114.stdout:276: read oid 12 snap -1 2026-02-20T13:10:15.430 INFO:tasks.rados.rados.0.trial114.stdout:276: expect (ObjNum 86 snap 12 seq_num 86) 2026-02-20T13:10:15.430 INFO:tasks.rados.rados.0.trial114.stdout:277: read oid 50 snap -1 2026-02-20T13:10:15.430 INFO:tasks.rados.rados.0.trial114.stdout:277: expect (ObjNum 85 snap 12 seq_num 85) 2026-02-20T13:10:15.430 INFO:tasks.rados.rados.0.trial114.stdout:278: delete oid 48 current snap is 34 2026-02-20T13:10:15.446 INFO:tasks.rados.rados.0.trial114.stdout:272: finishing write tid 1 to trial11441570-33 2026-02-20T13:10:15.453 INFO:tasks.rados.rados.0.trial114.stdout:272: finishing write tid 2 to trial11441570-33 2026-02-20T13:10:15.463 INFO:tasks.rados.rados.0.trial114.stdout:272: finishing write tid 3 to trial11441570-33 2026-02-20T13:10:15.465 INFO:tasks.rados.rados.0.trial114.stdout:272: finishing write tid 4 to trial11441570-33 2026-02-20T13:10:15.465 INFO:tasks.rados.rados.0.trial114.stdout:272: oid 33 updating version 0 to 32 2026-02-20T13:10:15.465 INFO:tasks.rados.rados.0.trial114.stdout:272: oid 33 version 32 is already newer than 32 2026-02-20T13:10:15.465 INFO:tasks.rados.rados.0.trial114.stdout:272: oid 33 version 32 is already newer than 32 2026-02-20T13:10:15.465 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 33 v 32 (ObjNum 142 snap 34 seq_num 142) dirty exists 2026-02-20T13:10:15.465 INFO:tasks.rados.rados.0.trial114.stdout:272: left oid 33 (ObjNum 142 snap 34 seq_num 142) 2026-02-20T13:10:15.471 INFO:tasks.rados.rados.0.trial114.stdout:274: finishing write tid 1 to trial11441570-39 2026-02-20T13:10:15.480 INFO:tasks.rados.rados.0.trial114.stdout:274: finishing write tid 2 to trial11441570-39 2026-02-20T13:10:15.484 INFO:tasks.rados.rados.0.trial114.stdout:274: finishing write tid 3 to trial11441570-39 2026-02-20T13:10:15.486 INFO:tasks.rados.rados.0.trial114.stdout:274: finishing write tid 4 to trial11441570-39 2026-02-20T13:10:15.486 INFO:tasks.rados.rados.0.trial114.stdout:274: oid 39 updating version 0 to 87 2026-02-20T13:10:15.486 INFO:tasks.rados.rados.0.trial114.stdout:274: oid 39 version 87 is already newer than 87 2026-02-20T13:10:15.486 INFO:tasks.rados.rados.0.trial114.stdout:274: oid 39 version 87 is already newer than 87 2026-02-20T13:10:15.486 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 39 v 87 (ObjNum 143 snap 34 seq_num 143) dirty exists 2026-02-20T13:10:15.486 INFO:tasks.rados.rados.0.trial114.stdout:274: left oid 39 (ObjNum 143 snap 34 seq_num 143) 2026-02-20T13:10:15.490 INFO:tasks.rados.rados.0.trial114.stdout:276: expect (ObjNum 86 snap 12 seq_num 86) 2026-02-20T13:10:15.600 INFO:tasks.rados.rados.0.trial114.stdout:272: done (6 left) 2026-02-20T13:10:15.601 INFO:tasks.rados.rados.0.trial114.stdout:273: done (5 left) 2026-02-20T13:10:15.601 INFO:tasks.rados.rados.0.trial114.stdout:274: done (4 left) 2026-02-20T13:10:15.601 INFO:tasks.rados.rados.0.trial114.stdout:275: done (3 left) 2026-02-20T13:10:15.601 INFO:tasks.rados.rados.0.trial114.stdout:276: done (2 left) 2026-02-20T13:10:15.601 INFO:tasks.rados.rados.0.trial114.stdout:278: done (1 left) 2026-02-20T13:10:15.601 INFO:tasks.rados.rados.0.trial114.stdout:279: read oid 27 snap -1 2026-02-20T13:10:15.601 INFO:tasks.rados.rados.0.trial114.stdout:279: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-20T13:10:15.601 INFO:tasks.rados.rados.0.trial114.stdout:280: read oid 13 snap -1 2026-02-20T13:10:15.601 INFO:tasks.rados.rados.0.trial114.stdout:280: expect (ObjNum 131 snap 29 seq_num 131) 2026-02-20T13:10:15.602 INFO:tasks.rados.rados.0.trial114.stdout:281: snap_remove snap 32 2026-02-20T13:10:15.863 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:15.941 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:15.938+0000 7f3b15acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:15.944 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:15.941+0000 7f3b15acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:15.971 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:15.987 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:15.988 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:16.417 INFO:tasks.rados.rados.0.trial114.stdout:281: done (3 left) 2026-02-20T13:10:16.417 INFO:tasks.rados.rados.0.trial114.stdout:282: write (excl) oid 1 current snap is 34 2026-02-20T13:10:16.418 INFO:tasks.rados.rados.0.trial114.stdout:282: seq_num 145 ranges {437015=721812,1701889=509708} 2026-02-20T13:10:16.422 INFO:tasks.rados.rados.0.trial114.stdout:282: writing trial11441570-1 from 437015 to 1158827 tid 1 2026-02-20T13:10:16.427 INFO:tasks.rados.rados.0.trial114.stdout:282: writing trial11441570-1 from 1701889 to 2211597 tid 2 2026-02-20T13:10:16.427 INFO:tasks.rados.rados.0.trial114.stdout:283: snap_create 2026-02-20T13:10:16.427 INFO:tasks.rados.rados.0.trial114.stdout:277: expect (ObjNum 85 snap 12 seq_num 85) 2026-02-20T13:10:16.427 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:16.530 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:16.581 INFO:tasks.rados.rados.0.trial114.stdout:280: expect (ObjNum 131 snap 29 seq_num 131) 2026-02-20T13:10:16.623 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:16.644 INFO:tasks.rados.rados.0.trial114.stdout:279: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-20T13:10:16.670 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:16.704 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 309199 2026-02-20T13:10:16.735 INFO:tasks.rados.rados.0.trial114.stdout:282: finishing write tid 1 to trial11441570-1 2026-02-20T13:10:16.736 INFO:tasks.rados.rados.0.trial114.stdout:282: finishing write tid 2 to trial11441570-1 2026-02-20T13:10:16.736 INFO:tasks.rados.rados.0.trial114.stdout:282: finishing write tid 3 to trial11441570-1 2026-02-20T13:10:16.736 INFO:tasks.rados.rados.0.trial114.stdout:282: finishing write tid 4 to trial11441570-1 2026-02-20T13:10:16.736 INFO:tasks.rados.rados.0.trial114.stdout:282: oid 1 updating version 0 to 26 2026-02-20T13:10:16.736 INFO:tasks.rados.rados.0.trial114.stdout:282: oid 1 version 26 is already newer than 24 2026-02-20T13:10:16.736 INFO:tasks.rados.rados.0.trial114.stdout:282: oid 1 version 26 is already newer than 26 2026-02-20T13:10:16.736 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 1 v 26 (ObjNum 145 snap 34 seq_num 145) dirty exists 2026-02-20T13:10:16.736 INFO:tasks.rados.rados.0.trial114.stdout:282: left oid 1 (ObjNum 145 snap 34 seq_num 145) 2026-02-20T13:10:17.420 INFO:tasks.rados.rados.0.trial114.stdout:277: done (4 left) 2026-02-20T13:10:17.421 INFO:tasks.rados.rados.0.trial114.stdout:279: done (3 left) 2026-02-20T13:10:17.421 INFO:tasks.rados.rados.0.trial114.stdout:280: done (2 left) 2026-02-20T13:10:17.421 INFO:tasks.rados.rados.0.trial114.stdout:282: done (1 left) 2026-02-20T13:10:17.421 INFO:tasks.rados.rados.0.trial114.stdout:283: done (0 left) 2026-02-20T13:10:17.421 INFO:tasks.rados.rados.0.trial114.stdout:284: read oid 26 snap 33 2026-02-20T13:10:17.421 INFO:tasks.rados.rados.0.trial114.stdout:284: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:10:17.421 INFO:tasks.rados.rados.0.trial114.stdout:285: write (excl) oid 34 current snap is 35 2026-02-20T13:10:17.421 INFO:tasks.rados.rados.0.trial114.stdout:285: seq_num 146 ranges {453822=797061,1760371=653366} 2026-02-20T13:10:17.425 INFO:tasks.rados.rados.0.trial114.stdout:285: writing trial11441570-34 from 453822 to 1250883 tid 1 2026-02-20T13:10:17.431 INFO:tasks.rados.rados.0.trial114.stdout:285: writing trial11441570-34 from 1760371 to 2413737 tid 2 2026-02-20T13:10:17.431 INFO:tasks.rados.rados.0.trial114.stdout:286: write (excl) oid 5 current snap is 35 2026-02-20T13:10:17.431 INFO:tasks.rados.rados.0.trial114.stdout:286: seq_num 147 ranges {470629=472310,1418853=513377} 2026-02-20T13:10:17.434 INFO:tasks.rados.rados.0.trial114.stdout:286: writing trial11441570-5 from 470629 to 942939 tid 1 2026-02-20T13:10:17.438 INFO:tasks.rados.rados.0.trial114.stdout:286: writing trial11441570-5 from 1418853 to 1932230 tid 2 2026-02-20T13:10:17.438 INFO:tasks.rados.rados.0.trial114.stdout:287: write oid 16 current snap is 35 2026-02-20T13:10:17.438 INFO:tasks.rados.rados.0.trial114.stdout:287: seq_num 148 ranges {487436=547559,1760982=657035} 2026-02-20T13:10:17.442 INFO:tasks.rados.rados.0.trial114.stdout:287: writing trial11441570-16 from 487436 to 1034995 tid 1 2026-02-20T13:10:17.447 INFO:tasks.rados.rados.0.trial114.stdout:287: writing trial11441570-16 from 1760982 to 2418017 tid 2 2026-02-20T13:10:17.447 INFO:tasks.rados.rados.0.trial114.stdout:288: snap_remove snap 34 2026-02-20T13:10:17.989 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:18.067 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:18.064+0000 7f9a86e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:18.070 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:18.067+0000 7f9a86e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:18.096 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:18.113 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:18.113 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:18.423 INFO:tasks.rados.rados.0.trial114.stdout:288: done (4 left) 2026-02-20T13:10:18.423 INFO:tasks.rados.rados.0.trial114.stdout:289: snap_remove snap 30 2026-02-20T13:10:19.365 INFO:tasks.rados.rados.0.trial114.stdout:289: done (4 left) 2026-02-20T13:10:19.365 INFO:tasks.rados.rados.0.trial114.stdout:290: snap_remove snap 21 2026-02-20T13:10:19.463 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:19.535 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:19.537 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:19.538 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:19.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~55s 2026-02-20T13:10:20.115 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:20.193 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:20.189+0000 7f48b670b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:20.195 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:20.193+0000 7f48b670b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:20.222 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:20.239 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:20.239 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:20.368 INFO:tasks.rados.rados.0.trial114.stdout:290: done (4 left) 2026-02-20T13:10:20.368 INFO:tasks.rados.rados.0.trial114.stdout:291: write oid 33 current snap is 35 2026-02-20T13:10:20.368 INFO:tasks.rados.rados.0.trial114.stdout:291: seq_num 149 ranges {504243=622808,1819464=517046} 2026-02-20T13:10:20.372 INFO:tasks.rados.rados.0.trial114.stdout:291: writing trial11441570-33 from 504243 to 1127051 tid 1 2026-02-20T13:10:20.377 INFO:tasks.rados.rados.0.trial114.stdout:291: writing trial11441570-33 from 1819464 to 2336510 tid 2 2026-02-20T13:10:20.377 INFO:tasks.rados.rados.0.trial114.stdout:292: write oid 23 current snap is 35 2026-02-20T13:10:20.377 INFO:tasks.rados.rados.0.trial114.stdout:292: seq_num 150 ranges {521050=698057,1877946=643104} 2026-02-20T13:10:20.381 INFO:tasks.rados.rados.0.trial114.stdout:292: writing trial11441570-23 from 521050 to 1219107 tid 1 2026-02-20T13:10:20.387 INFO:tasks.rados.rados.0.trial114.stdout:292: writing trial11441570-23 from 1877946 to 2521050 tid 2 2026-02-20T13:10:20.387 INFO:tasks.rados.rados.0.trial114.stdout:293: delete oid 21 current snap is 35 2026-02-20T13:10:20.387 INFO:tasks.rados.rados.0.trial114.stdout:286: finishing write tid 1 to trial11441570-5 2026-02-20T13:10:20.387 INFO:tasks.rados.rados.0.trial114.stdout:284: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:10:20.387 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:20.423 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:20.460 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:20.497 INFO:tasks.rados.rados.0.trial114.stdout:286: finishing write tid 2 to trial11441570-5 2026-02-20T13:10:20.497 INFO:tasks.rados.rados.0.trial114.stdout:285: finishing write tid 1 to trial11441570-34 2026-02-20T13:10:20.497 INFO:tasks.rados.rados.0.trial114.stdout:284: done (6 left) 2026-02-20T13:10:20.497 INFO:tasks.rados.rados.0.trial114.stdout:293: done (5 left) 2026-02-20T13:10:20.497 INFO:tasks.rados.rados.0.trial114.stdout:294: snap_remove snap 33 2026-02-20T13:10:21.429 INFO:tasks.rados.rados.0.trial114.stdout:294: done (5 left) 2026-02-20T13:10:21.429 INFO:tasks.rados.rados.0.trial114.stdout:295: read oid 37 snap -1 2026-02-20T13:10:21.429 INFO:tasks.rados.rados.0.trial114.stdout:295: expect deleted 2026-02-20T13:10:21.429 INFO:tasks.rados.rados.0.trial114.stdout:296: write oid 28 current snap is 35 2026-02-20T13:10:21.429 INFO:tasks.rados.rados.0.trial114.stdout:286: finishing write tid 3 to trial11441570-5 2026-02-20T13:10:21.429 INFO:tasks.rados.rados.0.trial114.stdout:296: seq_num 152 ranges {554664=448555,1478557=664373} 2026-02-20T13:10:21.432 INFO:tasks.rados.rados.0.trial114.stdout:296: writing trial11441570-28 from 554664 to 1003219 tid 1 2026-02-20T13:10:21.437 INFO:tasks.rados.rados.0.trial114.stdout:296: writing trial11441570-28 from 1478557 to 2142930 tid 2 2026-02-20T13:10:21.437 INFO:tasks.rados.rados.0.trial114.stdout:297: write (excl) oid 38 current snap is 35 2026-02-20T13:10:21.437 INFO:tasks.rados.rados.0.trial114.stdout:286: finishing write tid 4 to trial11441570-5 2026-02-20T13:10:21.437 INFO:tasks.rados.rados.0.trial114.stdout:286: oid 5 updating version 0 to 99 2026-02-20T13:10:21.437 INFO:tasks.rados.rados.0.trial114.stdout:286: oid 5 updating version 99 to 101 2026-02-20T13:10:21.437 INFO:tasks.rados.rados.0.trial114.stdout:286: oid 5 version 101 is already newer than 101 2026-02-20T13:10:21.438 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 5 v 101 (ObjNum 147 snap 35 seq_num 147) dirty exists 2026-02-20T13:10:21.438 INFO:tasks.rados.rados.0.trial114.stdout:286: left oid 5 (ObjNum 147 snap 35 seq_num 147) 2026-02-20T13:10:21.438 INFO:tasks.rados.rados.0.trial114.stdout:297: seq_num 153 ranges {571471=640157,1653392=524384} 2026-02-20T13:10:21.441 INFO:tasks.rados.rados.0.trial114.stdout:297: writing trial11441570-38 from 571471 to 1211628 tid 1 2026-02-20T13:10:21.446 INFO:tasks.rados.rados.0.trial114.stdout:297: writing trial11441570-38 from 1653392 to 2177776 tid 2 2026-02-20T13:10:21.446 INFO:tasks.rados.rados.0.trial114.stdout:286: done (7 left) 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:298: read oid 2 snap 31 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:298: expect (ObjNum 51 snap 0 seq_num 51) 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:299: snap_create 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:285: finishing write tid 2 to trial11441570-34 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:285: finishing write tid 3 to trial11441570-34 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:285: finishing write tid 4 to trial11441570-34 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:285: oid 34 updating version 0 to 63 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:285: oid 34 version 63 is already newer than 61 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:285: oid 34 version 63 is already newer than 63 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 34 v 63 (ObjNum 146 snap 35 seq_num 146) dirty exists 2026-02-20T13:10:21.447 INFO:tasks.rados.rados.0.trial114.stdout:285: left oid 34 (ObjNum 146 snap 35 seq_num 146) 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:287: finishing write tid 1 to trial11441570-16 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:287: finishing write tid 2 to trial11441570-16 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:287: finishing write tid 3 to trial11441570-16 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:287: finishing write tid 4 to trial11441570-16 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:287: oid 16 updating version 0 to 14 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:287: oid 16 version 14 is already newer than 14 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:287: oid 16 version 14 is already newer than 14 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 16 v 14 (ObjNum 148 snap 35 seq_num 148) dirty exists 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:287: left oid 16 (ObjNum 148 snap 35 seq_num 148) 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:291: finishing write tid 1 to trial11441570-33 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:291: finishing write tid 2 to trial11441570-33 2026-02-20T13:10:21.448 INFO:tasks.rados.rados.0.trial114.stdout:291: finishing write tid 3 to trial11441570-33 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:291: finishing write tid 4 to trial11441570-33 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:291: oid 33 updating version 0 to 35 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:291: oid 33 version 35 is already newer than 35 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:291: oid 33 version 35 is already newer than 35 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 33 v 35 (ObjNum 149 snap 35 seq_num 149) dirty exists 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:291: left oid 33 (ObjNum 149 snap 35 seq_num 149) 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:292: finishing write tid 1 to trial11441570-23 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:292: finishing write tid 2 to trial11441570-23 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:292: finishing write tid 3 to trial11441570-23 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:292: finishing write tid 4 to trial11441570-23 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:292: oid 23 updating version 0 to 97 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:292: oid 23 version 97 is already newer than 97 2026-02-20T13:10:21.449 INFO:tasks.rados.rados.0.trial114.stdout:292: oid 23 version 97 is already newer than 97 2026-02-20T13:10:21.450 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 23 v 97 (ObjNum 150 snap 35 seq_num 150) dirty exists 2026-02-20T13:10:21.450 INFO:tasks.rados.rados.0.trial114.stdout:292: left oid 23 (ObjNum 150 snap 35 seq_num 150) 2026-02-20T13:10:21.501 INFO:tasks.rados.rados.0.trial114.stdout:298: expect (ObjNum 51 snap 0 seq_num 51) 2026-02-20T13:10:21.501 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:21.537 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1074183 2026-02-20T13:10:21.561 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:21.594 INFO:tasks.rados.rados.0.trial114.stdout:296: finishing write tid 1 to trial11441570-28 2026-02-20T13:10:21.594 INFO:tasks.rados.rados.0.trial114.stdout:296: finishing write tid 2 to trial11441570-28 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:296: finishing write tid 3 to trial11441570-28 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:296: finishing write tid 4 to trial11441570-28 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:296: oid 28 updating version 0 to 75 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:296: oid 28 version 75 is already newer than 75 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:296: oid 28 version 75 is already newer than 75 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 28 v 75 (ObjNum 152 snap 35 seq_num 152) dirty exists 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:296: left oid 28 (ObjNum 152 snap 35 seq_num 152) 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:297: finishing write tid 1 to trial11441570-38 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:297: finishing write tid 2 to trial11441570-38 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:297: finishing write tid 3 to trial11441570-38 2026-02-20T13:10:21.595 INFO:tasks.rados.rados.0.trial114.stdout:297: finishing write tid 4 to trial11441570-38 2026-02-20T13:10:21.596 INFO:tasks.rados.rados.0.trial114.stdout:297: oid 38 updating version 0 to 79 2026-02-20T13:10:21.596 INFO:tasks.rados.rados.0.trial114.stdout:297: oid 38 version 79 is already newer than 79 2026-02-20T13:10:21.596 INFO:tasks.rados.rados.0.trial114.stdout:297: oid 38 version 79 is already newer than 77 2026-02-20T13:10:21.596 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 38 v 79 (ObjNum 153 snap 35 seq_num 153) dirty exists 2026-02-20T13:10:21.596 INFO:tasks.rados.rados.0.trial114.stdout:297: left oid 38 (ObjNum 153 snap 35 seq_num 153) 2026-02-20T13:10:22.240 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:22.316 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:22.311+0000 7f0419be4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:22.318 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:22.315+0000 7f0419be4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:22.344 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:22.360 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:22.361 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:22.430 INFO:tasks.rados.rados.0.trial114.stdout:285: done (8 left) 2026-02-20T13:10:22.430 INFO:tasks.rados.rados.0.trial114.stdout:287: done (7 left) 2026-02-20T13:10:22.430 INFO:tasks.rados.rados.0.trial114.stdout:291: done (6 left) 2026-02-20T13:10:22.430 INFO:tasks.rados.rados.0.trial114.stdout:292: done (5 left) 2026-02-20T13:10:22.430 INFO:tasks.rados.rados.0.trial114.stdout:295: done (4 left) 2026-02-20T13:10:22.430 INFO:tasks.rados.rados.0.trial114.stdout:296: done (3 left) 2026-02-20T13:10:22.430 INFO:tasks.rados.rados.0.trial114.stdout:297: done (2 left) 2026-02-20T13:10:22.431 INFO:tasks.rados.rados.0.trial114.stdout:298: done (1 left) 2026-02-20T13:10:22.431 INFO:tasks.rados.rados.0.trial114.stdout:299: done (0 left) 2026-02-20T13:10:22.431 INFO:tasks.rados.rados.0.trial114.stdout:300: snap_remove snap 35 2026-02-20T13:10:23.432 INFO:tasks.rados.rados.0.trial114.stdout:300: done (0 left) 2026-02-20T13:10:23.432 INFO:tasks.rados.rados.0.trial114.stdout:301: delete oid 9 current snap is 36 2026-02-20T13:10:23.487 INFO:tasks.rados.rados.0.trial114.stdout:301: done (0 left) 2026-02-20T13:10:23.487 INFO:tasks.rados.rados.0.trial114.stdout:302: write oid 13 current snap is 36 2026-02-20T13:10:23.488 INFO:tasks.rados.rados.0.trial114.stdout:302: seq_num 155 ranges {605085=790655,2170356=434729} 2026-02-20T13:10:23.493 INFO:tasks.rados.rados.0.trial114.stdout:302: writing trial11441570-13 from 605085 to 1395740 tid 1 2026-02-20T13:10:23.498 INFO:tasks.rados.rados.0.trial114.stdout:302: writing trial11441570-13 from 2170356 to 2605085 tid 2 2026-02-20T13:10:23.498 INFO:tasks.rados.rados.0.trial114.stdout:303: write (excl) oid 14 current snap is 36 2026-02-20T13:10:23.498 INFO:tasks.rados.rados.0.trial114.stdout:303: seq_num 156 ranges {621892=465904,1712485=671711} 2026-02-20T13:10:23.502 INFO:tasks.rados.rados.0.trial114.stdout:303: writing trial11441570-14 from 621892 to 1087796 tid 1 2026-02-20T13:10:23.507 INFO:tasks.rados.rados.0.trial114.stdout:303: writing trial11441570-14 from 1712485 to 2384196 tid 2 2026-02-20T13:10:23.508 INFO:tasks.rados.rados.0.trial114.stdout:304: read oid 27 snap -1 2026-02-20T13:10:23.508 INFO:tasks.rados.rados.0.trial114.stdout:304: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-20T13:10:23.508 INFO:tasks.rados.rados.0.trial114.stdout:305: snap_create 2026-02-20T13:10:23.529 INFO:tasks.rados.rados.0.trial114.stdout:304: expect (ObjNum 54 snap 1 seq_num 54) 2026-02-20T13:10:23.565 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:23.633 INFO:tasks.rados.rados.0.trial114.stdout:302: finishing write tid 1 to trial11441570-13 2026-02-20T13:10:23.633 INFO:tasks.rados.rados.0.trial114.stdout:302: finishing write tid 2 to trial11441570-13 2026-02-20T13:10:23.634 INFO:tasks.rados.rados.0.trial114.stdout:302: finishing write tid 3 to trial11441570-13 2026-02-20T13:10:23.634 INFO:tasks.rados.rados.0.trial114.stdout:302: finishing write tid 4 to trial11441570-13 2026-02-20T13:10:23.634 INFO:tasks.rados.rados.0.trial114.stdout:302: oid 13 updating version 0 to 65 2026-02-20T13:10:23.634 INFO:tasks.rados.rados.0.trial114.stdout:302: oid 13 version 65 is already newer than 65 2026-02-20T13:10:23.634 INFO:tasks.rados.rados.0.trial114.stdout:302: oid 13 version 65 is already newer than 65 2026-02-20T13:10:23.634 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 13 v 65 (ObjNum 155 snap 36 seq_num 155) dirty exists 2026-02-20T13:10:23.634 INFO:tasks.rados.rados.0.trial114.stdout:302: left oid 13 (ObjNum 155 snap 36 seq_num 155) 2026-02-20T13:10:23.634 INFO:tasks.rados.rados.0.trial114.stdout:303: finishing write tid 1 to trial11441570-14 2026-02-20T13:10:23.634 INFO:tasks.rados.rados.0.trial114.stdout:303: finishing write tid 2 to trial11441570-14 2026-02-20T13:10:23.635 INFO:tasks.rados.rados.0.trial114.stdout:303: finishing write tid 3 to trial11441570-14 2026-02-20T13:10:23.635 INFO:tasks.rados.rados.0.trial114.stdout:303: finishing write tid 4 to trial11441570-14 2026-02-20T13:10:23.635 INFO:tasks.rados.rados.0.trial114.stdout:303: oid 14 updating version 0 to 19 2026-02-20T13:10:23.635 INFO:tasks.rados.rados.0.trial114.stdout:303: oid 14 updating version 19 to 21 2026-02-20T13:10:23.635 INFO:tasks.rados.rados.0.trial114.stdout:303: oid 14 version 21 is already newer than 21 2026-02-20T13:10:23.635 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 14 v 21 (ObjNum 156 snap 36 seq_num 156) dirty exists 2026-02-20T13:10:23.635 INFO:tasks.rados.rados.0.trial114.stdout:303: left oid 14 (ObjNum 156 snap 36 seq_num 156) 2026-02-20T13:10:24.362 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:24.436 INFO:tasks.rados.rados.0.trial114.stdout:302: done (3 left) 2026-02-20T13:10:24.436 INFO:tasks.rados.rados.0.trial114.stdout:303: done (2 left) 2026-02-20T13:10:24.436 INFO:tasks.rados.rados.0.trial114.stdout:304: done (1 left) 2026-02-20T13:10:24.436 INFO:tasks.rados.rados.0.trial114.stdout:305: done (0 left) 2026-02-20T13:10:24.436 INFO:tasks.rados.rados.0.trial114.stdout:306: snap_remove snap 36 2026-02-20T13:10:24.437 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:24.432+0000 7fce0043d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:24.440 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:24.436+0000 7fce0043d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:24.473 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:24.488 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:24.488 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:24.539 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:24.611 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:24.614 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:24.614 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:25.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~61s 2026-02-20T13:10:25.438 INFO:tasks.rados.rados.0.trial114.stdout:306: done (0 left) 2026-02-20T13:10:25.438 INFO:tasks.rados.rados.0.trial114.stdout:307: read oid 22 snap -1 2026-02-20T13:10:25.438 INFO:tasks.rados.rados.0.trial114.stdout:307: expect (ObjNum 136 snap 33 seq_num 136) 2026-02-20T13:10:25.438 INFO:tasks.rados.rados.0.trial114.stdout:308: write oid 10 current snap is 37 2026-02-20T13:10:25.438 INFO:tasks.rados.rados.0.trial114.stdout:308: seq_num 157 ranges {638699=541153,1770967=531722} 2026-02-20T13:10:25.443 INFO:tasks.rados.rados.0.trial114.stdout:308: writing trial11441570-10 from 638699 to 1179852 tid 1 2026-02-20T13:10:25.447 INFO:tasks.rados.rados.0.trial114.stdout:308: writing trial11441570-10 from 1770967 to 2302689 tid 2 2026-02-20T13:10:25.448 INFO:tasks.rados.rados.0.trial114.stdout:309: delete oid 15 current snap is 37 2026-02-20T13:10:25.475 INFO:tasks.rados.rados.0.trial114.stdout:308: finishing write tid 1 to trial11441570-10 2026-02-20T13:10:25.483 INFO:tasks.rados.rados.0.trial114.stdout:308: finishing write tid 2 to trial11441570-10 2026-02-20T13:10:25.487 INFO:tasks.rados.rados.0.trial114.stdout:308: finishing write tid 3 to trial11441570-10 2026-02-20T13:10:25.488 INFO:tasks.rados.rados.0.trial114.stdout:308: finishing write tid 4 to trial11441570-10 2026-02-20T13:10:25.488 INFO:tasks.rados.rados.0.trial114.stdout:308: oid 10 updating version 0 to 66 2026-02-20T13:10:25.488 INFO:tasks.rados.rados.0.trial114.stdout:308: oid 10 version 66 is already newer than 66 2026-02-20T13:10:25.488 INFO:tasks.rados.rados.0.trial114.stdout:308: oid 10 version 66 is already newer than 66 2026-02-20T13:10:25.488 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 10 v 66 (ObjNum 157 snap 37 seq_num 157) dirty exists 2026-02-20T13:10:25.489 INFO:tasks.rados.rados.0.trial114.stdout:308: left oid 10 (ObjNum 157 snap 37 seq_num 157) 2026-02-20T13:10:25.491 INFO:tasks.rados.rados.0.trial114.stdout:308: done (2 left) 2026-02-20T13:10:25.491 INFO:tasks.rados.rados.0.trial114.stdout:309: done (1 left) 2026-02-20T13:10:25.491 INFO:tasks.rados.rados.0.trial114.stdout:310: snap_create 2026-02-20T13:10:25.492 INFO:tasks.rados.rados.0.trial114.stdout:307: expect (ObjNum 136 snap 33 seq_num 136) 2026-02-20T13:10:25.492 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 307598 2026-02-20T13:10:25.516 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 501890 2026-02-20T13:10:25.551 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1954522 2026-02-20T13:10:26.444 INFO:tasks.rados.rados.0.trial114.stdout:307: done (1 left) 2026-02-20T13:10:26.445 INFO:tasks.rados.rados.0.trial114.stdout:310: done (0 left) 2026-02-20T13:10:26.445 INFO:tasks.rados.rados.0.trial114.stdout:311: write (excl) oid 13 current snap is 38 2026-02-20T13:10:26.445 INFO:tasks.rados.rados.0.trial114.stdout:311: seq_num 159 ranges {672313=691651,1887931=419038} 2026-02-20T13:10:26.449 INFO:tasks.rados.rados.0.trial114.stdout:311: writing trial11441570-13 from 672313 to 1363964 tid 1 2026-02-20T13:10:26.453 INFO:tasks.rados.rados.0.trial114.stdout:311: writing trial11441570-13 from 1887931 to 2306969 tid 2 2026-02-20T13:10:26.453 INFO:tasks.rados.rados.0.trial114.stdout:312: write oid 48 current snap is 38 2026-02-20T13:10:26.453 INFO:tasks.rados.rados.0.trial114.stdout:312: seq_num 160 ranges {689120=483253,1946413=679049} 2026-02-20T13:10:26.458 INFO:tasks.rados.rados.0.trial114.stdout:312: writing trial11441570-48 from 689120 to 1172373 tid 1 2026-02-20T13:10:26.464 INFO:tasks.rados.rados.0.trial114.stdout:312: writing trial11441570-48 from 1946413 to 2625462 tid 2 2026-02-20T13:10:26.464 INFO:tasks.rados.rados.0.trial114.stdout:313: write (excl) oid 12 current snap is 38 2026-02-20T13:10:26.464 INFO:tasks.rados.rados.0.trial114.stdout:313: seq_num 161 ranges {705927=558502,2004895=422707} 2026-02-20T13:10:26.469 INFO:tasks.rados.rados.0.trial114.stdout:313: writing trial11441570-12 from 705927 to 1264429 tid 1 2026-02-20T13:10:26.474 INFO:tasks.rados.rados.0.trial114.stdout:313: writing trial11441570-12 from 2004895 to 2427602 tid 2 2026-02-20T13:10:26.474 INFO:tasks.rados.rados.0.trial114.stdout:314: snap_remove snap 31 2026-02-20T13:10:26.489 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:26.567 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:26.562+0000 7f7c6830b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:26.570 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:26.566+0000 7f7c6830b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:26.596 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:26.611 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:26.611 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:27.447 INFO:tasks.rados.rados.0.trial114.stdout:314: done (3 left) 2026-02-20T13:10:27.447 INFO:tasks.rados.rados.0.trial114.stdout:315: snap_create 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:312: finishing write tid 1 to trial11441570-48 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:312: finishing write tid 2 to trial11441570-48 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:311: finishing write tid 1 to trial11441570-13 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:312: finishing write tid 3 to trial11441570-48 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:312: finishing write tid 4 to trial11441570-48 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:312: oid 48 updating version 0 to 47 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:312: oid 48 version 47 is already newer than 47 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:312: oid 48 version 47 is already newer than 47 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 48 v 47 (ObjNum 160 snap 38 seq_num 160) dirty exists 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:312: left oid 48 (ObjNum 160 snap 38 seq_num 160) 2026-02-20T13:10:27.448 INFO:tasks.rados.rados.0.trial114.stdout:311: finishing write tid 2 to trial11441570-13 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:313: finishing write tid 1 to trial11441570-12 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:311: finishing write tid 3 to trial11441570-13 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:311: finishing write tid 4 to trial11441570-13 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:311: oid 13 updating version 0 to 69 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:311: oid 13 version 69 is already newer than 69 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:311: oid 13 version 69 is already newer than 67 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 13 v 69 (ObjNum 159 snap 38 seq_num 159) dirty exists 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:311: left oid 13 (ObjNum 159 snap 38 seq_num 159) 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:313: finishing write tid 2 to trial11441570-12 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:313: finishing write tid 3 to trial11441570-12 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:313: finishing write tid 4 to trial11441570-12 2026-02-20T13:10:27.449 INFO:tasks.rados.rados.0.trial114.stdout:313: oid 12 updating version 0 to 76 2026-02-20T13:10:27.450 INFO:tasks.rados.rados.0.trial114.stdout:313: oid 12 version 76 is already newer than 76 2026-02-20T13:10:27.450 INFO:tasks.rados.rados.0.trial114.stdout:313: oid 12 version 76 is already newer than 74 2026-02-20T13:10:27.450 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 12 v 76 (ObjNum 161 snap 38 seq_num 161) dirty exists 2026-02-20T13:10:27.450 INFO:tasks.rados.rados.0.trial114.stdout:313: left oid 12 (ObjNum 161 snap 38 seq_num 161) 2026-02-20T13:10:28.451 INFO:tasks.rados.rados.0.trial114.stdout:311: done (3 left) 2026-02-20T13:10:28.452 INFO:tasks.rados.rados.0.trial114.stdout:312: done (2 left) 2026-02-20T13:10:28.452 INFO:tasks.rados.rados.0.trial114.stdout:313: done (1 left) 2026-02-20T13:10:28.452 INFO:tasks.rados.rados.0.trial114.stdout:315: done (0 left) 2026-02-20T13:10:28.452 INFO:tasks.rados.rados.0.trial114.stdout:316: snap_create 2026-02-20T13:10:28.612 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:28.689 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:28.684+0000 7fa9c6a11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:28.691 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:28.688+0000 7fa9c6a11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:28.718 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:28.735 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:28.735 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:29.363 INFO:tasks.rados.rados.0.trial114.stdout:316: done (0 left) 2026-02-20T13:10:29.363 INFO:tasks.rados.rados.0.trial114.stdout:317: write (excl) oid 14 current snap is 40 2026-02-20T13:10:29.364 INFO:tasks.rados.rados.0.trial114.stdout:317: seq_num 162 ranges {722734=633751,2063377=659357} 2026-02-20T13:10:29.368 INFO:tasks.rados.rados.0.trial114.stdout:317: writing trial11441570-14 from 722734 to 1356485 tid 1 2026-02-20T13:10:29.374 INFO:tasks.rados.rados.0.trial114.stdout:317: writing trial11441570-14 from 2063377 to 2722734 tid 2 2026-02-20T13:10:29.374 INFO:tasks.rados.rados.0.trial114.stdout:318: write (excl) oid 17 current snap is 40 2026-02-20T13:10:29.374 INFO:tasks.rados.rados.0.trial114.stdout:318: seq_num 163 ranges {739541=709000,2121859=426376} 2026-02-20T13:10:29.379 INFO:tasks.rados.rados.0.trial114.stdout:318: writing trial11441570-17 from 739541 to 1448541 tid 1 2026-02-20T13:10:29.384 INFO:tasks.rados.rados.0.trial114.stdout:318: writing trial11441570-17 from 2121859 to 2548235 tid 2 2026-02-20T13:10:29.384 INFO:tasks.rados.rados.0.trial114.stdout:319: write oid 24 current snap is 40 2026-02-20T13:10:29.384 INFO:tasks.rados.rados.0.trial114.stdout:319: seq_num 164 ranges {756348=784249,2063988=686387} 2026-02-20T13:10:29.390 INFO:tasks.rados.rados.0.trial114.stdout:319: writing trial11441570-24 from 756348 to 1540597 tid 1 2026-02-20T13:10:29.395 INFO:tasks.rados.rados.0.trial114.stdout:319: writing trial11441570-24 from 2063988 to 2750375 tid 2 2026-02-20T13:10:29.396 INFO:tasks.rados.rados.0.trial114.stdout:320: snap_remove snap 39 2026-02-20T13:10:29.615 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:29.686 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:29.689 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:29.689 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:30.365 INFO:tasks.rados.rados.0.trial114.stdout:320: done (3 left) 2026-02-20T13:10:30.366 INFO:tasks.rados.rados.0.trial114.stdout:321: snap_create 2026-02-20T13:10:30.366 INFO:tasks.rados.rados.0.trial114.stdout:317: finishing write tid 1 to trial11441570-14 2026-02-20T13:10:30.366 INFO:tasks.rados.rados.0.trial114.stdout:318: finishing write tid 1 to trial11441570-17 2026-02-20T13:10:30.366 INFO:tasks.rados.rados.0.trial114.stdout:317: finishing write tid 2 to trial11441570-14 2026-02-20T13:10:30.366 INFO:tasks.rados.rados.0.trial114.stdout:318: finishing write tid 2 to trial11441570-17 2026-02-20T13:10:30.366 INFO:tasks.rados.rados.0.trial114.stdout:317: finishing write tid 3 to trial11441570-14 2026-02-20T13:10:30.366 INFO:tasks.rados.rados.0.trial114.stdout:317: finishing write tid 4 to trial11441570-14 2026-02-20T13:10:30.366 INFO:tasks.rados.rados.0.trial114.stdout:317: oid 14 updating version 0 to 25 2026-02-20T13:10:30.366 INFO:tasks.rados.rados.0.trial114.stdout:317: oid 14 version 25 is already newer than 23 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:317: oid 14 version 25 is already newer than 25 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 14 v 25 (ObjNum 162 snap 40 seq_num 162) dirty exists 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:317: left oid 14 (ObjNum 162 snap 40 seq_num 162) 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:318: finishing write tid 3 to trial11441570-17 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:318: finishing write tid 4 to trial11441570-17 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:318: oid 17 updating version 0 to 36 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:318: oid 17 updating version 36 to 38 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:318: oid 17 version 38 is already newer than 38 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 17 v 38 (ObjNum 163 snap 40 seq_num 163) dirty exists 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:318: left oid 17 (ObjNum 163 snap 40 seq_num 163) 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:319: finishing write tid 1 to trial11441570-24 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:319: finishing write tid 2 to trial11441570-24 2026-02-20T13:10:30.367 INFO:tasks.rados.rados.0.trial114.stdout:319: finishing write tid 3 to trial11441570-24 2026-02-20T13:10:30.368 INFO:tasks.rados.rados.0.trial114.stdout:319: finishing write tid 4 to trial11441570-24 2026-02-20T13:10:30.368 INFO:tasks.rados.rados.0.trial114.stdout:319: oid 24 updating version 0 to 115 2026-02-20T13:10:30.368 INFO:tasks.rados.rados.0.trial114.stdout:319: oid 24 version 115 is already newer than 115 2026-02-20T13:10:30.368 INFO:tasks.rados.rados.0.trial114.stdout:319: oid 24 version 115 is already newer than 115 2026-02-20T13:10:30.368 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 24 v 115 (ObjNum 164 snap 40 seq_num 164) dirty exists 2026-02-20T13:10:30.368 INFO:tasks.rados.rados.0.trial114.stdout:319: left oid 24 (ObjNum 164 snap 40 seq_num 164) 2026-02-20T13:10:30.737 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:30.813 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:30.808+0000 7f31cc7cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:30.816 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:30.812+0000 7f31cc7cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:30.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~66s 2026-02-20T13:10:30.843 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:30.858 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:30.859 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:31.364 INFO:tasks.rados.rados.0.trial114.stdout:317: done (3 left) 2026-02-20T13:10:31.365 INFO:tasks.rados.rados.0.trial114.stdout:318: done (2 left) 2026-02-20T13:10:31.365 INFO:tasks.rados.rados.0.trial114.stdout:319: done (1 left) 2026-02-20T13:10:31.365 INFO:tasks.rados.rados.0.trial114.stdout:321: done (0 left) 2026-02-20T13:10:31.365 INFO:tasks.rados.rados.0.trial114.stdout:322: delete oid 12 current snap is 41 2026-02-20T13:10:31.402 INFO:tasks.rados.rados.0.trial114.stdout:322: done (0 left) 2026-02-20T13:10:31.403 INFO:tasks.rados.rados.0.trial114.stdout:323: write (excl) oid 43 current snap is 41 2026-02-20T13:10:31.403 INFO:tasks.rados.rados.0.trial114.stdout:323: seq_num 166 ranges {789962=534747,1780952=690056} 2026-02-20T13:10:31.407 INFO:tasks.rados.rados.0.trial114.stdout:323: writing trial11441570-43 from 789962 to 1324709 tid 1 2026-02-20T13:10:31.412 INFO:tasks.rados.rados.0.trial114.stdout:323: writing trial11441570-43 from 1780952 to 2471008 tid 2 2026-02-20T13:10:31.412 INFO:tasks.rados.rados.0.trial114.stdout:324: snap_create 2026-02-20T13:10:31.434 INFO:tasks.rados.rados.0.trial114.stdout:323: finishing write tid 1 to trial11441570-43 2026-02-20T13:10:31.453 INFO:tasks.rados.rados.0.trial114.stdout:323: finishing write tid 2 to trial11441570-43 2026-02-20T13:10:31.463 INFO:tasks.rados.rados.0.trial114.stdout:323: finishing write tid 3 to trial11441570-43 2026-02-20T13:10:31.465 INFO:tasks.rados.rados.0.trial114.stdout:323: finishing write tid 4 to trial11441570-43 2026-02-20T13:10:31.465 INFO:tasks.rados.rados.0.trial114.stdout:323: oid 43 updating version 0 to 115 2026-02-20T13:10:31.465 INFO:tasks.rados.rados.0.trial114.stdout:323: oid 43 updating version 115 to 117 2026-02-20T13:10:31.465 INFO:tasks.rados.rados.0.trial114.stdout:323: oid 43 version 117 is already newer than 117 2026-02-20T13:10:31.465 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 43 v 117 (ObjNum 166 snap 41 seq_num 166) dirty exists 2026-02-20T13:10:31.465 INFO:tasks.rados.rados.0.trial114.stdout:323: left oid 43 (ObjNum 166 snap 41 seq_num 166) 2026-02-20T13:10:32.372 INFO:tasks.rados.rados.0.trial114.stdout:323: done (1 left) 2026-02-20T13:10:32.372 INFO:tasks.rados.rados.0.trial114.stdout:324: done (0 left) 2026-02-20T13:10:32.372 INFO:tasks.rados.rados.0.trial114.stdout:325: snap_create 2026-02-20T13:10:32.859 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:32.936 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:32.932+0000 7f16b305a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:32.938 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:32.935+0000 7f16b305a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:32.965 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:32.980 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:32.981 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:33.372 INFO:tasks.rados.rados.0.trial114.stdout:325: done (0 left) 2026-02-20T13:10:33.372 INFO:tasks.rados.rados.0.trial114.stdout:326: write oid 45 current snap is 43 2026-02-20T13:10:33.372 INFO:tasks.rados.rados.0.trial114.stdout:326: seq_num 167 ranges {406769=609996,1439434=433714,2303522=503247} 2026-02-20T13:10:33.375 INFO:tasks.rados.rados.0.trial114.stdout:326: writing trial11441570-45 from 406769 to 1016765 tid 1 2026-02-20T13:10:33.379 INFO:tasks.rados.rados.0.trial114.stdout:326: writing trial11441570-45 from 1439434 to 1873148 tid 2 2026-02-20T13:10:33.383 INFO:tasks.rados.rados.0.trial114.stdout:326: writing trial11441570-45 from 2303522 to 2806769 tid 3 2026-02-20T13:10:33.383 INFO:tasks.rados.rados.0.trial114.stdout:327: snap_create 2026-02-20T13:10:33.415 INFO:tasks.rados.rados.0.trial114.stdout:326: finishing write tid 1 to trial11441570-45 2026-02-20T13:10:33.421 INFO:tasks.rados.rados.0.trial114.stdout:326: finishing write tid 2 to trial11441570-45 2026-02-20T13:10:33.427 INFO:tasks.rados.rados.0.trial114.stdout:326: finishing write tid 3 to trial11441570-45 2026-02-20T13:10:33.429 INFO:tasks.rados.rados.0.trial114.stdout:326: finishing write tid 4 to trial11441570-45 2026-02-20T13:10:33.431 INFO:tasks.rados.rados.0.trial114.stdout:326: finishing write tid 5 to trial11441570-45 2026-02-20T13:10:33.431 INFO:tasks.rados.rados.0.trial114.stdout:326: oid 45 updating version 0 to 126 2026-02-20T13:10:33.431 INFO:tasks.rados.rados.0.trial114.stdout:326: oid 45 version 126 is already newer than 126 2026-02-20T13:10:33.431 INFO:tasks.rados.rados.0.trial114.stdout:326: oid 45 version 126 is already newer than 126 2026-02-20T13:10:33.431 INFO:tasks.rados.rados.0.trial114.stdout:326: oid 45 version 126 is already newer than 126 2026-02-20T13:10:33.431 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 45 v 126 (ObjNum 167 snap 43 seq_num 167) dirty exists 2026-02-20T13:10:33.432 INFO:tasks.rados.rados.0.trial114.stdout:326: left oid 45 (ObjNum 167 snap 43 seq_num 167) 2026-02-20T13:10:34.377 INFO:tasks.rados.rados.0.trial114.stdout:326: done (1 left) 2026-02-20T13:10:34.377 INFO:tasks.rados.rados.0.trial114.stdout:327: done (0 left) 2026-02-20T13:10:34.377 INFO:tasks.rados.rados.0.trial114.stdout:328: snap_create 2026-02-20T13:10:34.691 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:34.762 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:34.764 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:34.765 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:34.982 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:35.058 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:35.054+0000 7f9d99fc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:35.060 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:35.058+0000 7f9d99fc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:35.087 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:35.103 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:35.104 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:35.378 INFO:tasks.rados.rados.0.trial114.stdout:328: done (0 left) 2026-02-20T13:10:35.378 INFO:tasks.rados.rados.0.trial114.stdout:329: delete oid 13 current snap is 45 2026-02-20T13:10:35.426 INFO:tasks.rados.rados.0.trial114.stdout:329: done (0 left) 2026-02-20T13:10:35.426 INFO:tasks.rados.rados.0.trial114.stdout:330: write (excl) oid 36 current snap is 45 2026-02-20T13:10:35.426 INFO:tasks.rados.rados.0.trial114.stdout:330: seq_num 169 ranges {440383=476847,1556398=437383,2474721=365662} 2026-02-20T13:10:35.429 INFO:tasks.rados.rados.0.trial114.stdout:330: writing trial11441570-36 from 440383 to 917230 tid 1 2026-02-20T13:10:35.433 INFO:tasks.rados.rados.0.trial114.stdout:330: writing trial11441570-36 from 1556398 to 1993781 tid 2 2026-02-20T13:10:35.437 INFO:tasks.rados.rados.0.trial114.stdout:330: writing trial11441570-36 from 2474721 to 2840383 tid 3 2026-02-20T13:10:35.437 INFO:tasks.rados.rados.0.trial114.stdout:331: snap_create 2026-02-20T13:10:35.445 INFO:tasks.rados.rados.0.trial114.stdout:330: finishing write tid 1 to trial11441570-36 2026-02-20T13:10:35.457 INFO:tasks.rados.rados.0.trial114.stdout:330: finishing write tid 2 to trial11441570-36 2026-02-20T13:10:35.462 INFO:tasks.rados.rados.0.trial114.stdout:330: finishing write tid 3 to trial11441570-36 2026-02-20T13:10:35.465 INFO:tasks.rados.rados.0.trial114.stdout:330: finishing write tid 4 to trial11441570-36 2026-02-20T13:10:35.466 INFO:tasks.rados.rados.0.trial114.stdout:330: finishing write tid 5 to trial11441570-36 2026-02-20T13:10:35.466 INFO:tasks.rados.rados.0.trial114.stdout:330: oid 36 updating version 0 to 118 2026-02-20T13:10:35.466 INFO:tasks.rados.rados.0.trial114.stdout:330: oid 36 updating version 118 to 121 2026-02-20T13:10:35.466 INFO:tasks.rados.rados.0.trial114.stdout:330: oid 36 version 121 is already newer than 121 2026-02-20T13:10:35.466 INFO:tasks.rados.rados.0.trial114.stdout:330: oid 36 version 121 is already newer than 121 2026-02-20T13:10:35.467 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 36 v 121 (ObjNum 169 snap 45 seq_num 169) dirty exists 2026-02-20T13:10:35.467 INFO:tasks.rados.rados.0.trial114.stdout:330: left oid 36 (ObjNum 169 snap 45 seq_num 169) 2026-02-20T13:10:36.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~72s 2026-02-20T13:10:36.384 INFO:tasks.rados.rados.0.trial114.stdout:330: done (1 left) 2026-02-20T13:10:36.384 INFO:tasks.rados.rados.0.trial114.stdout:331: done (0 left) 2026-02-20T13:10:36.385 INFO:tasks.rados.rados.0.trial114.stdout:332: read oid 48 snap -1 2026-02-20T13:10:36.385 INFO:tasks.rados.rados.0.trial114.stdout:332: expect (ObjNum 160 snap 38 seq_num 160) 2026-02-20T13:10:36.385 INFO:tasks.rados.rados.0.trial114.stdout:333: snap_remove snap 43 2026-02-20T13:10:37.104 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:37.179 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:37.175+0000 7fed4c4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:37.181 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:37.179+0000 7fed4c4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:37.207 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:37.224 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:37.225 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:37.386 INFO:tasks.rados.rados.0.trial114.stdout:333: done (1 left) 2026-02-20T13:10:37.386 INFO:tasks.rados.rados.0.trial114.stdout:334: write oid 27 current snap is 46 2026-02-20T13:10:37.387 INFO:tasks.rados.rados.0.trial114.stdout:334: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2026-02-20T13:10:37.390 INFO:tasks.rados.rados.0.trial114.stdout:334: writing trial11441570-27 from 457190 to 1009286 tid 1 2026-02-20T13:10:37.396 INFO:tasks.rados.rados.0.trial114.stdout:334: writing trial11441570-27 from 1614880 to 2195921 tid 2 2026-02-20T13:10:37.399 INFO:tasks.rados.rados.0.trial114.stdout:334: writing trial11441570-27 from 2785791 to 2857190 tid 3 2026-02-20T13:10:37.399 INFO:tasks.rados.rados.0.trial114.stdout:335: read oid 23 snap -1 2026-02-20T13:10:37.399 INFO:tasks.rados.rados.0.trial114.stdout:335: expect (ObjNum 150 snap 35 seq_num 150) 2026-02-20T13:10:37.399 INFO:tasks.rados.rados.0.trial114.stdout:336: write oid 43 current snap is 46 2026-02-20T13:10:37.399 INFO:tasks.rados.rados.0.trial114.stdout:336: seq_num 171 ranges {473997=627345,1673362=441052,2529567=344430} 2026-02-20T13:10:37.403 INFO:tasks.rados.rados.0.trial114.stdout:336: writing trial11441570-43 from 473997 to 1101342 tid 1 2026-02-20T13:10:37.407 INFO:tasks.rados.rados.0.trial114.stdout:336: writing trial11441570-43 from 1673362 to 2114414 tid 2 2026-02-20T13:10:37.410 INFO:tasks.rados.rados.0.trial114.stdout:336: writing trial11441570-43 from 2529567 to 2873997 tid 3 2026-02-20T13:10:37.410 INFO:tasks.rados.rados.0.trial114.stdout:337: write oid 31 current snap is 46 2026-02-20T13:10:37.410 INFO:tasks.rados.rados.0.trial114.stdout:332: expect (ObjNum 160 snap 38 seq_num 160) 2026-02-20T13:10:37.414 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 966165 2026-02-20T13:10:37.451 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:37.474 INFO:tasks.rados.rados.0.trial114.stdout:337: seq_num 172 ranges {490804=702594,1615491=584710,2724284=166520} 2026-02-20T13:10:37.479 INFO:tasks.rados.rados.0.trial114.stdout:337: writing trial11441570-31 from 490804 to 1193398 tid 1 2026-02-20T13:10:37.482 INFO:tasks.rados.rados.0.trial114.stdout:337: writing trial11441570-31 from 1615491 to 2200201 tid 2 2026-02-20T13:10:37.485 INFO:tasks.rados.rados.0.trial114.stdout:337: writing trial11441570-31 from 2724284 to 2890804 tid 3 2026-02-20T13:10:37.485 INFO:tasks.rados.rados.0.trial114.stdout:332: done (4 left) 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:338: read oid 8 snap -1 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:338: expect (ObjNum 101 snap 16 seq_num 101) 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:339: read oid 14 snap 42 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:339: expect (ObjNum 162 snap 40 seq_num 162) 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:340: read oid 21 snap 44 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:340: expect deleted 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:341: read oid 16 snap 38 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:341: expect (ObjNum 148 snap 35 seq_num 148) 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:342: read oid 18 snap -1 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:342: expect deleted 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:343: snap_create 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:335: expect (ObjNum 150 snap 35 seq_num 150) 2026-02-20T13:10:37.486 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:37.550 INFO:tasks.rados.rados.0.trial114.stdout:334: finishing write tid 1 to trial11441570-27 2026-02-20T13:10:37.550 INFO:tasks.rados.rados.0.trial114.stdout:334: finishing write tid 2 to trial11441570-27 2026-02-20T13:10:37.550 INFO:tasks.rados.rados.0.trial114.stdout:334: finishing write tid 3 to trial11441570-27 2026-02-20T13:10:37.550 INFO:tasks.rados.rados.0.trial114.stdout:334: finishing write tid 4 to trial11441570-27 2026-02-20T13:10:37.550 INFO:tasks.rados.rados.0.trial114.stdout:334: finishing write tid 5 to trial11441570-27 2026-02-20T13:10:37.550 INFO:tasks.rados.rados.0.trial114.stdout:334: oid 27 updating version 0 to 84 2026-02-20T13:10:37.551 INFO:tasks.rados.rados.0.trial114.stdout:334: oid 27 version 84 is already newer than 84 2026-02-20T13:10:37.551 INFO:tasks.rados.rados.0.trial114.stdout:334: oid 27 version 84 is already newer than 84 2026-02-20T13:10:37.551 INFO:tasks.rados.rados.0.trial114.stdout:334: oid 27 version 84 is already newer than 84 2026-02-20T13:10:37.551 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 27 v 84 (ObjNum 170 snap 46 seq_num 170) dirty exists 2026-02-20T13:10:37.551 INFO:tasks.rados.rados.0.trial114.stdout:334: left oid 27 (ObjNum 170 snap 46 seq_num 170) 2026-02-20T13:10:37.551 INFO:tasks.rados.rados.0.trial114.stdout:338: expect (ObjNum 101 snap 16 seq_num 101) 2026-02-20T13:10:37.551 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:37.606 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 3032426 2026-02-20T13:10:37.638 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 3454128 2026-02-20T13:10:37.639 INFO:tasks.rados.rados.0.trial114.stdout:339: expect (ObjNum 162 snap 40 seq_num 162) 2026-02-20T13:10:37.639 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:37.672 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 120353 2026-02-20T13:10:37.703 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:37.735 INFO:tasks.rados.rados.0.trial114.stdout:337: finishing write tid 1 to trial11441570-31 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:336: finishing write tid 1 to trial11441570-43 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:337: finishing write tid 2 to trial11441570-31 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:336: finishing write tid 2 to trial11441570-43 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:337: finishing write tid 3 to trial11441570-31 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:337: finishing write tid 4 to trial11441570-31 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:337: finishing write tid 5 to trial11441570-31 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:337: oid 31 updating version 0 to 71 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:337: oid 31 version 71 is already newer than 71 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:337: oid 31 version 71 is already newer than 71 2026-02-20T13:10:37.736 INFO:tasks.rados.rados.0.trial114.stdout:337: oid 31 version 71 is already newer than 71 2026-02-20T13:10:37.737 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 31 v 71 (ObjNum 172 snap 46 seq_num 172) dirty exists 2026-02-20T13:10:37.737 INFO:tasks.rados.rados.0.trial114.stdout:337: left oid 31 (ObjNum 172 snap 46 seq_num 172) 2026-02-20T13:10:37.737 INFO:tasks.rados.rados.0.trial114.stdout:336: finishing write tid 3 to trial11441570-43 2026-02-20T13:10:37.737 INFO:tasks.rados.rados.0.trial114.stdout:336: finishing write tid 4 to trial11441570-43 2026-02-20T13:10:37.737 INFO:tasks.rados.rados.0.trial114.stdout:341: expect (ObjNum 148 snap 35 seq_num 148) 2026-02-20T13:10:37.788 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1954670 2026-02-20T13:10:37.833 INFO:tasks.rados.rados.0.trial114.stdout:336: finishing write tid 5 to trial11441570-43 2026-02-20T13:10:37.833 INFO:tasks.rados.rados.0.trial114.stdout:336: oid 43 updating version 0 to 126 2026-02-20T13:10:37.833 INFO:tasks.rados.rados.0.trial114.stdout:336: oid 43 version 126 is already newer than 126 2026-02-20T13:10:37.833 INFO:tasks.rados.rados.0.trial114.stdout:336: oid 43 version 126 is already newer than 126 2026-02-20T13:10:37.833 INFO:tasks.rados.rados.0.trial114.stdout:336: oid 43 version 126 is already newer than 126 2026-02-20T13:10:37.833 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 43 v 126 (ObjNum 171 snap 46 seq_num 171) dirty exists 2026-02-20T13:10:37.833 INFO:tasks.rados.rados.0.trial114.stdout:336: left oid 43 (ObjNum 171 snap 46 seq_num 171) 2026-02-20T13:10:38.391 INFO:tasks.rados.rados.0.trial114.stdout:334: done (9 left) 2026-02-20T13:10:38.391 INFO:tasks.rados.rados.0.trial114.stdout:335: done (8 left) 2026-02-20T13:10:38.391 INFO:tasks.rados.rados.0.trial114.stdout:336: done (7 left) 2026-02-20T13:10:38.391 INFO:tasks.rados.rados.0.trial114.stdout:337: done (6 left) 2026-02-20T13:10:38.391 INFO:tasks.rados.rados.0.trial114.stdout:338: done (5 left) 2026-02-20T13:10:38.392 INFO:tasks.rados.rados.0.trial114.stdout:339: done (4 left) 2026-02-20T13:10:38.392 INFO:tasks.rados.rados.0.trial114.stdout:340: done (3 left) 2026-02-20T13:10:38.392 INFO:tasks.rados.rados.0.trial114.stdout:341: done (2 left) 2026-02-20T13:10:38.392 INFO:tasks.rados.rados.0.trial114.stdout:342: done (1 left) 2026-02-20T13:10:38.392 INFO:tasks.rados.rados.0.trial114.stdout:343: done (0 left) 2026-02-20T13:10:38.392 INFO:tasks.rados.rados.0.trial114.stdout:344: read oid 38 snap 38 2026-02-20T13:10:38.392 INFO:tasks.rados.rados.0.trial114.stdout:344: expect (ObjNum 153 snap 35 seq_num 153) 2026-02-20T13:10:38.392 INFO:tasks.rados.rados.0.trial114.stdout:345: delete oid 20 current snap is 47 2026-02-20T13:10:38.416 INFO:tasks.rados.rados.0.trial114.stdout:344: expect (ObjNum 153 snap 35 seq_num 153) 2026-02-20T13:10:38.450 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 846630 2026-02-20T13:10:38.499 INFO:tasks.rados.rados.0.trial114.stdout:344: done (1 left) 2026-02-20T13:10:38.500 INFO:tasks.rados.rados.0.trial114.stdout:345: done (0 left) 2026-02-20T13:10:38.500 INFO:tasks.rados.rados.0.trial114.stdout:346: read oid 15 snap 44 2026-02-20T13:10:38.500 INFO:tasks.rados.rados.0.trial114.stdout:346: expect deleted 2026-02-20T13:10:38.500 INFO:tasks.rados.rados.0.trial114.stdout:347: snap_remove snap 45 2026-02-20T13:10:39.226 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:39.304 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:39.300+0000 7fe0d710b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:39.306 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:39.304+0000 7fe0d710b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:39.333 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:39.348 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:39.349 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:39.364 INFO:tasks.rados.rados.0.trial114.stdout:347: done (1 left) 2026-02-20T13:10:39.365 INFO:tasks.rados.rados.0.trial114.stdout:348: snap_create 2026-02-20T13:10:39.766 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:39.837 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:39.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:39.841 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:40.369 INFO:tasks.rados.rados.0.trial114.stdout:346: done (1 left) 2026-02-20T13:10:40.369 INFO:tasks.rados.rados.0.trial114.stdout:348: done (0 left) 2026-02-20T13:10:40.369 INFO:tasks.rados.rados.0.trial114.stdout:349: snap_remove snap 46 2026-02-20T13:10:41.349 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:41.369 INFO:tasks.rados.rados.0.trial114.stdout:349: done (0 left) 2026-02-20T13:10:41.369 INFO:tasks.rados.rados.0.trial114.stdout:350: read oid 6 snap -1 2026-02-20T13:10:41.369 INFO:tasks.rados.rados.0.trial114.stdout:350: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-20T13:10:41.369 INFO:tasks.rados.rados.0.trial114.stdout:351: snap_remove snap 47 2026-02-20T13:10:41.430 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:41.426+0000 7f990681a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:41.432 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:41.429+0000 7f990681a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:41.459 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:41.474 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:41.475 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:41.838 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~77s 2026-02-20T13:10:42.375 INFO:tasks.rados.rados.0.trial114.stdout:351: done (1 left) 2026-02-20T13:10:42.376 INFO:tasks.rados.rados.0.trial114.stdout:352: read oid 38 snap -1 2026-02-20T13:10:42.376 INFO:tasks.rados.rados.0.trial114.stdout:352: expect (ObjNum 153 snap 35 seq_num 153) 2026-02-20T13:10:42.376 INFO:tasks.rados.rados.0.trial114.stdout:353: snap_remove snap 37 2026-02-20T13:10:43.378 INFO:tasks.rados.rados.0.trial114.stdout:353: done (2 left) 2026-02-20T13:10:43.378 INFO:tasks.rados.rados.0.trial114.stdout:354: snap_create 2026-02-20T13:10:43.378 INFO:tasks.rados.rados.0.trial114.stdout:350: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-20T13:10:43.397 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:43.436 INFO:tasks.rados.rados.0.trial114.stdout:352: expect (ObjNum 153 snap 35 seq_num 153) 2026-02-20T13:10:43.436 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:43.465 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:43.476 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:43.551 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:43.547+0000 7f2f5fa1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:43.553 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:43.551+0000 7f2f5fa1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:43.579 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:43.596 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:43.596 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:44.384 INFO:tasks.rados.rados.0.trial114.stdout:350: done (2 left) 2026-02-20T13:10:44.384 INFO:tasks.rados.rados.0.trial114.stdout:352: done (1 left) 2026-02-20T13:10:44.384 INFO:tasks.rados.rados.0.trial114.stdout:354: done (0 left) 2026-02-20T13:10:44.384 INFO:tasks.rados.rados.0.trial114.stdout:355: snap_remove snap 42 2026-02-20T13:10:44.841 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:44.913 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:44.916 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:44.916 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:45.386 INFO:tasks.rados.rados.0.trial114.stdout:355: done (0 left) 2026-02-20T13:10:45.386 INFO:tasks.rados.rados.0.trial114.stdout:356: delete oid 48 current snap is 49 2026-02-20T13:10:45.424 INFO:tasks.rados.rados.0.trial114.stdout:356: done (0 left) 2026-02-20T13:10:45.424 INFO:tasks.rados.rados.0.trial114.stdout:357: read oid 46 snap -1 2026-02-20T13:10:45.424 INFO:tasks.rados.rados.0.trial114.stdout:357: expect (ObjNum 89 snap 14 seq_num 89) 2026-02-20T13:10:45.425 INFO:tasks.rados.rados.0.trial114.stdout:358: write (excl) oid 44 current snap is 49 2026-02-20T13:10:45.425 INFO:tasks.rados.rados.0.trial114.stdout:358: seq_num 175 ranges {541225=644694,1907290=448390} 2026-02-20T13:10:45.428 INFO:tasks.rados.rados.0.trial114.stdout:358: writing trial11441570-44 from 541225 to 1185919 tid 1 2026-02-20T13:10:45.433 INFO:tasks.rados.rados.0.trial114.stdout:358: writing trial11441570-44 from 1907290 to 2355680 tid 2 2026-02-20T13:10:45.433 INFO:tasks.rados.rados.0.trial114.stdout:359: write oid 11 current snap is 49 2026-02-20T13:10:45.433 INFO:tasks.rados.rados.0.trial114.stdout:359: seq_num 176 ranges {558032=719943,1849419=592048} 2026-02-20T13:10:45.438 INFO:tasks.rados.rados.0.trial114.stdout:359: writing trial11441570-11 from 558032 to 1277975 tid 1 2026-02-20T13:10:45.443 INFO:tasks.rados.rados.0.trial114.stdout:359: writing trial11441570-11 from 1849419 to 2441467 tid 2 2026-02-20T13:10:45.443 INFO:tasks.rados.rados.0.trial114.stdout:360: snap_create 2026-02-20T13:10:45.479 INFO:tasks.rados.rados.0.trial114.stdout:358: finishing write tid 1 to trial11441570-44 2026-02-20T13:10:45.501 INFO:tasks.rados.rados.0.trial114.stdout:358: finishing write tid 2 to trial11441570-44 2026-02-20T13:10:45.512 INFO:tasks.rados.rados.0.trial114.stdout:358: finishing write tid 3 to trial11441570-44 2026-02-20T13:10:45.515 INFO:tasks.rados.rados.0.trial114.stdout:359: finishing write tid 1 to trial11441570-11 2026-02-20T13:10:45.518 INFO:tasks.rados.rados.0.trial114.stdout:358: finishing write tid 4 to trial11441570-44 2026-02-20T13:10:45.518 INFO:tasks.rados.rados.0.trial114.stdout:358: oid 44 updating version 0 to 135 2026-02-20T13:10:45.518 INFO:tasks.rados.rados.0.trial114.stdout:358: oid 44 version 135 is already newer than 135 2026-02-20T13:10:45.518 INFO:tasks.rados.rados.0.trial114.stdout:358: oid 44 version 135 is already newer than 133 2026-02-20T13:10:45.519 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 135 (ObjNum 175 snap 49 seq_num 175) dirty exists 2026-02-20T13:10:45.519 INFO:tasks.rados.rados.0.trial114.stdout:358: left oid 44 (ObjNum 175 snap 49 seq_num 175) 2026-02-20T13:10:45.522 INFO:tasks.rados.rados.0.trial114.stdout:359: finishing write tid 2 to trial11441570-11 2026-02-20T13:10:45.529 INFO:tasks.rados.rados.0.trial114.stdout:359: finishing write tid 3 to trial11441570-11 2026-02-20T13:10:45.533 INFO:tasks.rados.rados.0.trial114.stdout:359: finishing write tid 4 to trial11441570-11 2026-02-20T13:10:45.533 INFO:tasks.rados.rados.0.trial114.stdout:359: oid 11 updating version 0 to 48 2026-02-20T13:10:45.533 INFO:tasks.rados.rados.0.trial114.stdout:359: oid 11 version 48 is already newer than 48 2026-02-20T13:10:45.533 INFO:tasks.rados.rados.0.trial114.stdout:359: oid 11 version 48 is already newer than 48 2026-02-20T13:10:45.533 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 11 v 48 (ObjNum 176 snap 49 seq_num 176) dirty exists 2026-02-20T13:10:45.533 INFO:tasks.rados.rados.0.trial114.stdout:359: left oid 11 (ObjNum 176 snap 49 seq_num 176) 2026-02-20T13:10:45.544 INFO:tasks.rados.rados.0.trial114.stdout:357: expect (ObjNum 89 snap 14 seq_num 89) 2026-02-20T13:10:45.544 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:45.597 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:45.645 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:45.674 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:45.670+0000 7fbceb21a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:45.676 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:45.674+0000 7fbceb21a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:45.702 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:45.732 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:45.733 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:46.392 INFO:tasks.rados.rados.0.trial114.stdout:357: done (3 left) 2026-02-20T13:10:46.392 INFO:tasks.rados.rados.0.trial114.stdout:358: done (2 left) 2026-02-20T13:10:46.392 INFO:tasks.rados.rados.0.trial114.stdout:359: done (1 left) 2026-02-20T13:10:46.392 INFO:tasks.rados.rados.0.trial114.stdout:360: done (0 left) 2026-02-20T13:10:46.392 INFO:tasks.rados.rados.0.trial114.stdout:361: snap_remove snap 40 2026-02-20T13:10:47.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~83s 2026-02-20T13:10:47.392 INFO:tasks.rados.rados.0.trial114.stdout:361: done (0 left) 2026-02-20T13:10:47.392 INFO:tasks.rados.rados.0.trial114.stdout:362: snap_create 2026-02-20T13:10:47.734 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:47.810 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:47.806+0000 7f67f585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:47.812 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:47.810+0000 7f67f585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:47.839 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:47.856 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:47.857 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:48.399 INFO:tasks.rados.rados.0.trial114.stdout:362: done (0 left) 2026-02-20T13:10:48.399 INFO:tasks.rados.rados.0.trial114.stdout:363: read oid 32 snap -1 2026-02-20T13:10:48.399 INFO:tasks.rados.rados.0.trial114.stdout:363: expect (ObjNum 124 snap 26 seq_num 124) 2026-02-20T13:10:48.399 INFO:tasks.rados.rados.0.trial114.stdout:364: snap_remove snap 41 2026-02-20T13:10:49.368 INFO:tasks.rados.rados.0.trial114.stdout:364: done (1 left) 2026-02-20T13:10:49.368 INFO:tasks.rados.rados.0.trial114.stdout:365: snap_create 2026-02-20T13:10:49.368 INFO:tasks.rados.rados.0.trial114.stdout:363: expect (ObjNum 124 snap 26 seq_num 124) 2026-02-20T13:10:49.368 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:49.394 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:49.418 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:49.858 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:49.918 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:49.938 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:49.934+0000 7fbd7f6b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:49.940 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:49.938+0000 7fbd7f6b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:49.967 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:49.984 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:49.985 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:49.991 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:49.994 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:49.994 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:50.370 INFO:tasks.rados.rados.0.trial114.stdout:363: done (1 left) 2026-02-20T13:10:50.370 INFO:tasks.rados.rados.0.trial114.stdout:365: done (0 left) 2026-02-20T13:10:50.370 INFO:tasks.rados.rados.0.trial114.stdout:366: read oid 5 snap -1 2026-02-20T13:10:50.371 INFO:tasks.rados.rados.0.trial114.stdout:366: expect (ObjNum 147 snap 35 seq_num 147) 2026-02-20T13:10:50.371 INFO:tasks.rados.rados.0.trial114.stdout:367: snap_create 2026-02-20T13:10:50.400 INFO:tasks.rados.rados.0.trial114.stdout:366: expect (ObjNum 147 snap 35 seq_num 147) 2026-02-20T13:10:50.400 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 359329 2026-02-20T13:10:50.420 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:51.371 INFO:tasks.rados.rados.0.trial114.stdout:366: done (1 left) 2026-02-20T13:10:51.371 INFO:tasks.rados.rados.0.trial114.stdout:367: done (0 left) 2026-02-20T13:10:51.371 INFO:tasks.rados.rados.0.trial114.stdout:368: read oid 37 snap -1 2026-02-20T13:10:51.371 INFO:tasks.rados.rados.0.trial114.stdout:368: expect deleted 2026-02-20T13:10:51.371 INFO:tasks.rados.rados.0.trial114.stdout:369: write (excl) oid 44 current snap is 53 2026-02-20T13:10:51.372 INFO:tasks.rados.rados.0.trial114.stdout:369: seq_num 177 ranges {574839=795192,1907901=452059} 2026-02-20T13:10:51.376 INFO:tasks.rados.rados.0.trial114.stdout:369: writing trial11441570-44 from 574839 to 1370031 tid 1 2026-02-20T13:10:51.380 INFO:tasks.rados.rados.0.trial114.stdout:369: writing trial11441570-44 from 1907901 to 2359960 tid 2 2026-02-20T13:10:51.380 INFO:tasks.rados.rados.0.trial114.stdout:370: read oid 26 snap -1 2026-02-20T13:10:51.380 INFO:tasks.rados.rados.0.trial114.stdout:370: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:10:51.380 INFO:tasks.rados.rados.0.trial114.stdout:371: snap_remove snap 52 2026-02-20T13:10:51.986 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:52.063 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:52.059+0000 7f93d1b7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:52.065 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:52.063+0000 7f93d1b7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:52.091 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:52.107 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:52.108 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:52.371 INFO:tasks.rados.rados.0.trial114.stdout:371: done (3 left) 2026-02-20T13:10:52.371 INFO:tasks.rados.rados.0.trial114.stdout:372: write oid 21 current snap is 53 2026-02-20T13:10:52.372 INFO:tasks.rados.rados.0.trial114.stdout:372: seq_num 178 ranges {591646=470441,1566383=595717,2888822=102824} 2026-02-20T13:10:52.375 INFO:tasks.rados.rados.0.trial114.stdout:372: writing trial11441570-21 from 591646 to 1062087 tid 1 2026-02-20T13:10:52.379 INFO:tasks.rados.rados.0.trial114.stdout:372: writing trial11441570-21 from 1566383 to 2162100 tid 2 2026-02-20T13:10:52.383 INFO:tasks.rados.rados.0.trial114.stdout:372: writing trial11441570-21 from 2888822 to 2991646 tid 3 2026-02-20T13:10:52.383 INFO:tasks.rados.rados.0.trial114.stdout:373: read oid 4 snap -1 2026-02-20T13:10:52.383 INFO:tasks.rados.rados.0.trial114.stdout:373: expect (ObjNum 135 snap 33 seq_num 135) 2026-02-20T13:10:52.383 INFO:tasks.rados.rados.0.trial114.stdout:374: write (excl) oid 6 current snap is 53 2026-02-20T13:10:52.383 INFO:tasks.rados.rados.0.trial114.stdout:374: seq_num 179 ranges {608453=545690,1624865=455728,2632598=375855} 2026-02-20T13:10:52.387 INFO:tasks.rados.rados.0.trial114.stdout:374: writing trial11441570-6 from 608453 to 1154143 tid 1 2026-02-20T13:10:52.391 INFO:tasks.rados.rados.0.trial114.stdout:374: writing trial11441570-6 from 1624865 to 2080593 tid 2 2026-02-20T13:10:52.394 INFO:tasks.rados.rados.0.trial114.stdout:374: writing trial11441570-6 from 2632598 to 3008453 tid 3 2026-02-20T13:10:52.394 INFO:tasks.rados.rados.0.trial114.stdout:375: delete oid 49 current snap is 53 2026-02-20T13:10:52.394 INFO:tasks.rados.rados.0.trial114.stdout:370: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:10:52.427 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:52.490 INFO:tasks.rados.rados.0.trial114.stdout:369: finishing write tid 1 to trial11441570-44 2026-02-20T13:10:52.490 INFO:tasks.rados.rados.0.trial114.stdout:369: finishing write tid 2 to trial11441570-44 2026-02-20T13:10:52.490 INFO:tasks.rados.rados.0.trial114.stdout:369: finishing write tid 3 to trial11441570-44 2026-02-20T13:10:52.490 INFO:tasks.rados.rados.0.trial114.stdout:368: done (6 left) 2026-02-20T13:10:52.490 INFO:tasks.rados.rados.0.trial114.stdout:370: done (5 left) 2026-02-20T13:10:52.490 INFO:tasks.rados.rados.0.trial114.stdout:375: done (4 left) 2026-02-20T13:10:52.490 INFO:tasks.rados.rados.0.trial114.stdout:376: read oid 49 snap 49 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:376: expect (ObjNum 104 snap 17 seq_num 104) 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:377: read oid 26 snap 51 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:377: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:378: snap_create 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:369: finishing write tid 4 to trial11441570-44 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:369: oid 44 updating version 0 to 143 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:369: oid 44 version 143 is already newer than 143 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:369: oid 44 version 143 is already newer than 141 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 143 (ObjNum 177 snap 53 seq_num 177) dirty exists 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:369: left oid 44 (ObjNum 177 snap 53 seq_num 177) 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:372: finishing write tid 1 to trial11441570-21 2026-02-20T13:10:52.491 INFO:tasks.rados.rados.0.trial114.stdout:372: finishing write tid 2 to trial11441570-21 2026-02-20T13:10:52.492 INFO:tasks.rados.rados.0.trial114.stdout:372: finishing write tid 3 to trial11441570-21 2026-02-20T13:10:52.492 INFO:tasks.rados.rados.0.trial114.stdout:373: expect (ObjNum 135 snap 33 seq_num 135) 2026-02-20T13:10:52.519 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 583001 2026-02-20T13:10:52.541 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:52.568 INFO:tasks.rados.rados.0.trial114.stdout:372: finishing write tid 4 to trial11441570-21 2026-02-20T13:10:52.568 INFO:tasks.rados.rados.0.trial114.stdout:372: finishing write tid 5 to trial11441570-21 2026-02-20T13:10:52.568 INFO:tasks.rados.rados.0.trial114.stdout:372: oid 21 updating version 0 to 24 2026-02-20T13:10:52.568 INFO:tasks.rados.rados.0.trial114.stdout:372: oid 21 version 24 is already newer than 24 2026-02-20T13:10:52.568 INFO:tasks.rados.rados.0.trial114.stdout:372: oid 21 version 24 is already newer than 24 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:372: oid 21 version 24 is already newer than 24 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 21 v 24 (ObjNum 178 snap 53 seq_num 178) dirty exists 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:372: left oid 21 (ObjNum 178 snap 53 seq_num 178) 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:374: finishing write tid 1 to trial11441570-6 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:374: finishing write tid 2 to trial11441570-6 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:374: finishing write tid 3 to trial11441570-6 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:374: finishing write tid 4 to trial11441570-6 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:374: finishing write tid 5 to trial11441570-6 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:374: oid 6 updating version 0 to 83 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:374: oid 6 version 83 is already newer than 80 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:374: oid 6 version 83 is already newer than 83 2026-02-20T13:10:52.569 INFO:tasks.rados.rados.0.trial114.stdout:374: oid 6 version 83 is already newer than 83 2026-02-20T13:10:52.570 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 6 v 83 (ObjNum 179 snap 53 seq_num 179) dirty exists 2026-02-20T13:10:52.570 INFO:tasks.rados.rados.0.trial114.stdout:374: left oid 6 (ObjNum 179 snap 53 seq_num 179) 2026-02-20T13:10:52.570 INFO:tasks.rados.rados.0.trial114.stdout:377: expect (ObjNum 77 snap 12 seq_num 77) 2026-02-20T13:10:52.587 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2984726 2026-02-20T13:10:52.605 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2743341 2026-02-20T13:10:52.614 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:52.651 INFO:tasks.rados.rados.0.trial114.stdout:376: expect (ObjNum 104 snap 17 seq_num 104) 2026-02-20T13:10:52.651 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:52.683 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:52.726 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2962833 2026-02-20T13:10:52.847 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2026-02-20T13:10:53.408 INFO:tasks.rados.rados.0.trial114.stdout:369: done (6 left) 2026-02-20T13:10:53.409 INFO:tasks.rados.rados.0.trial114.stdout:372: done (5 left) 2026-02-20T13:10:53.409 INFO:tasks.rados.rados.0.trial114.stdout:373: done (4 left) 2026-02-20T13:10:53.409 INFO:tasks.rados.rados.0.trial114.stdout:374: done (3 left) 2026-02-20T13:10:53.409 INFO:tasks.rados.rados.0.trial114.stdout:376: done (2 left) 2026-02-20T13:10:53.409 INFO:tasks.rados.rados.0.trial114.stdout:377: done (1 left) 2026-02-20T13:10:53.409 INFO:tasks.rados.rados.0.trial114.stdout:378: done (0 left) 2026-02-20T13:10:53.409 INFO:tasks.rados.rados.0.trial114.stdout:379: write (excl) oid 33 current snap is 54 2026-02-20T13:10:53.409 INFO:tasks.rados.rados.0.trial114.stdout:379: seq_num 181 ranges {642067=696188,2025476=459397,2971091=70976} 2026-02-20T13:10:53.414 INFO:tasks.rados.rados.0.trial114.stdout:379: writing trial11441570-33 from 642067 to 1338255 tid 1 2026-02-20T13:10:53.418 INFO:tasks.rados.rados.0.trial114.stdout:379: writing trial11441570-33 from 2025476 to 2484873 tid 2 2026-02-20T13:10:53.420 INFO:tasks.rados.rados.0.trial114.stdout:379: writing trial11441570-33 from 2971091 to 3042067 tid 3 2026-02-20T13:10:53.420 INFO:tasks.rados.rados.0.trial114.stdout:380: write oid 9 current snap is 54 2026-02-20T13:10:53.420 INFO:tasks.rados.rados.0.trial114.stdout:380: seq_num 182 ranges {658874=771437,2083958=603055} 2026-02-20T13:10:53.425 INFO:tasks.rados.rados.0.trial114.stdout:380: writing trial11441570-9 from 658874 to 1430311 tid 1 2026-02-20T13:10:53.431 INFO:tasks.rados.rados.0.trial114.stdout:380: writing trial11441570-9 from 2083958 to 2687013 tid 2 2026-02-20T13:10:53.431 INFO:tasks.rados.rados.0.trial114.stdout:381: write (excl) oid 10 current snap is 54 2026-02-20T13:10:53.431 INFO:tasks.rados.rados.0.trial114.stdout:381: seq_num 183 ranges {675681=563039,1858793=746713,3025937=49744} 2026-02-20T13:10:53.435 INFO:tasks.rados.rados.0.trial114.stdout:381: writing trial11441570-10 from 675681 to 1238720 tid 1 2026-02-20T13:10:53.441 INFO:tasks.rados.rados.0.trial114.stdout:381: writing trial11441570-10 from 1858793 to 2605506 tid 2 2026-02-20T13:10:53.443 INFO:tasks.rados.rados.0.trial114.stdout:381: writing trial11441570-10 from 3025937 to 3075681 tid 3 2026-02-20T13:10:53.443 INFO:tasks.rados.rados.0.trial114.stdout:382: write (excl) oid 18 current snap is 54 2026-02-20T13:10:53.443 INFO:tasks.rados.rados.0.trial114.stdout:382: seq_num 184 ranges {692488=638288,1917275=606724} 2026-02-20T13:10:53.449 INFO:tasks.rados.rados.0.trial114.stdout:382: writing trial11441570-18 from 692488 to 1330776 tid 1 2026-02-20T13:10:53.453 INFO:tasks.rados.rados.0.trial114.stdout:382: writing trial11441570-18 from 1917275 to 2523999 tid 2 2026-02-20T13:10:53.453 INFO:tasks.rados.rados.0.trial114.stdout:383: snap_remove snap 49 2026-02-20T13:10:54.109 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:54.183 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:54.179+0000 7fb9f2b7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:54.185 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:54.183+0000 7fb9f2b7b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:54.212 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:54.228 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:54.229 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:54.411 INFO:tasks.rados.rados.0.trial114.stdout:383: done (4 left) 2026-02-20T13:10:54.411 INFO:tasks.rados.rados.0.trial114.stdout:384: read oid 30 snap 38 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:384: expect (ObjNum 139 snap 33 seq_num 139) 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:385: read oid 22 snap 53 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:385: expect (ObjNum 136 snap 33 seq_num 136) 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:386: snap_create 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:380: finishing write tid 1 to trial11441570-9 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:382: finishing write tid 1 to trial11441570-18 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:380: finishing write tid 2 to trial11441570-9 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:382: finishing write tid 2 to trial11441570-18 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:380: finishing write tid 3 to trial11441570-9 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:380: finishing write tid 4 to trial11441570-9 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:380: oid 9 updating version 0 to 86 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:380: oid 9 version 86 is already newer than 86 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:380: oid 9 version 86 is already newer than 86 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 9 v 86 (ObjNum 182 snap 54 seq_num 182) dirty exists 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:380: left oid 9 (ObjNum 182 snap 54 seq_num 182) 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:382: finishing write tid 3 to trial11441570-18 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:382: finishing write tid 4 to trial11441570-18 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:382: oid 18 updating version 0 to 52 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:382: oid 18 version 52 is already newer than 50 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:382: oid 18 version 52 is already newer than 52 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 18 v 52 (ObjNum 184 snap 54 seq_num 184) dirty exists 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:382: left oid 18 (ObjNum 184 snap 54 seq_num 184) 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: finishing write tid 1 to trial11441570-10 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: finishing write tid 2 to trial11441570-10 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: finishing write tid 3 to trial11441570-10 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: finishing write tid 4 to trial11441570-10 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: finishing write tid 5 to trial11441570-10 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: oid 10 updating version 0 to 73 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: oid 10 updating version 73 to 76 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: oid 10 version 76 is already newer than 76 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: oid 10 version 76 is already newer than 76 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 10 v 76 (ObjNum 183 snap 54 seq_num 183) dirty exists 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:381: left oid 10 (ObjNum 183 snap 54 seq_num 183) 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: finishing write tid 1 to trial11441570-33 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: finishing write tid 2 to trial11441570-33 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: finishing write tid 3 to trial11441570-33 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: finishing write tid 4 to trial11441570-33 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: finishing write tid 5 to trial11441570-33 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: oid 33 updating version 0 to 40 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: oid 33 version 40 is already newer than 40 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: oid 33 version 40 is already newer than 40 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: oid 33 version 40 is already newer than 37 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 33 v 40 (ObjNum 181 snap 54 seq_num 181) dirty exists 2026-02-20T13:10:54.412 INFO:tasks.rados.rados.0.trial114.stdout:379: left oid 33 (ObjNum 181 snap 54 seq_num 181) 2026-02-20T13:10:54.449 INFO:tasks.rados.rados.0.trial114.stdout:384: expect (ObjNum 139 snap 33 seq_num 139) 2026-02-20T13:10:54.535 INFO:tasks.rados.rados.0.trial114.stdout:385: expect (ObjNum 136 snap 33 seq_num 136) 2026-02-20T13:10:54.995 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:10:55.065 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:10:55.068 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:10:55.068 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:10:55.414 INFO:tasks.rados.rados.0.trial114.stdout:379: done (6 left) 2026-02-20T13:10:55.415 INFO:tasks.rados.rados.0.trial114.stdout:380: done (5 left) 2026-02-20T13:10:55.415 INFO:tasks.rados.rados.0.trial114.stdout:381: done (4 left) 2026-02-20T13:10:55.415 INFO:tasks.rados.rados.0.trial114.stdout:382: done (3 left) 2026-02-20T13:10:55.415 INFO:tasks.rados.rados.0.trial114.stdout:384: done (2 left) 2026-02-20T13:10:55.415 INFO:tasks.rados.rados.0.trial114.stdout:385: done (1 left) 2026-02-20T13:10:55.415 INFO:tasks.rados.rados.0.trial114.stdout:386: done (0 left) 2026-02-20T13:10:55.415 INFO:tasks.rados.rados.0.trial114.stdout:387: read oid 6 snap 38 2026-02-20T13:10:55.415 INFO:tasks.rados.rados.0.trial114.stdout:387: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-20T13:10:55.415 INFO:tasks.rados.rados.0.trial114.stdout:388: snap_create 2026-02-20T13:10:55.439 INFO:tasks.rados.rados.0.trial114.stdout:387: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-20T13:10:55.440 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:56.230 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:10:56.308 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:56.303+0000 7f6a4a10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:56.310 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:56.307+0000 7f6a4a10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:56.338 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:56.353 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:56.354 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:56.419 INFO:tasks.rados.rados.0.trial114.stdout:387: done (1 left) 2026-02-20T13:10:56.419 INFO:tasks.rados.rados.0.trial114.stdout:388: done (0 left) 2026-02-20T13:10:56.419 INFO:tasks.rados.rados.0.trial114.stdout:389: delete oid 23 current snap is 56 2026-02-20T13:10:56.456 INFO:tasks.rados.rados.0.trial114.stdout:389: done (0 left) 2026-02-20T13:10:56.456 INFO:tasks.rados.rados.0.trial114.stdout:390: read oid 31 snap -1 2026-02-20T13:10:56.456 INFO:tasks.rados.rados.0.trial114.stdout:390: expect (ObjNum 172 snap 46 seq_num 172) 2026-02-20T13:10:56.456 INFO:tasks.rados.rados.0.trial114.stdout:391: read oid 32 snap 38 2026-02-20T13:10:56.456 INFO:tasks.rados.rados.0.trial114.stdout:391: expect (ObjNum 124 snap 26 seq_num 124) 2026-02-20T13:10:56.456 INFO:tasks.rados.rados.0.trial114.stdout:392: delete oid 22 current snap is 56 2026-02-20T13:10:56.477 INFO:tasks.rados.rados.0.trial114.stdout:391: expect (ObjNum 124 snap 26 seq_num 124) 2026-02-20T13:10:56.545 INFO:tasks.rados.rados.0.trial114.stdout:390: expect (ObjNum 172 snap 46 seq_num 172) 2026-02-20T13:10:56.545 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:56.576 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:56.612 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 798167 2026-02-20T13:10:56.636 INFO:tasks.rados.rados.0.trial114.stdout:390: done (2 left) 2026-02-20T13:10:56.636 INFO:tasks.rados.rados.0.trial114.stdout:391: done (1 left) 2026-02-20T13:10:56.636 INFO:tasks.rados.rados.0.trial114.stdout:392: done (0 left) 2026-02-20T13:10:56.637 INFO:tasks.rados.rados.0.trial114.stdout:393: read oid 21 snap -1 2026-02-20T13:10:56.637 INFO:tasks.rados.rados.0.trial114.stdout:393: expect (ObjNum 178 snap 53 seq_num 178) 2026-02-20T13:10:56.637 INFO:tasks.rados.rados.0.trial114.stdout:394: read oid 32 snap 54 2026-02-20T13:10:56.637 INFO:tasks.rados.rados.0.trial114.stdout:394: expect (ObjNum 124 snap 26 seq_num 124) 2026-02-20T13:10:56.637 INFO:tasks.rados.rados.0.trial114.stdout:395: write (excl) oid 24 current snap is 56 2026-02-20T13:10:56.637 INFO:tasks.rados.rados.0.trial114.stdout:395: seq_num 187 ranges {742909=464035,1976368=754051} 2026-02-20T13:10:56.641 INFO:tasks.rados.rados.0.trial114.stdout:395: writing trial11441570-24 from 742909 to 1206944 tid 1 2026-02-20T13:10:56.647 INFO:tasks.rados.rados.0.trial114.stdout:395: writing trial11441570-24 from 1976368 to 2730419 tid 2 2026-02-20T13:10:56.647 INFO:tasks.rados.rados.0.trial114.stdout:396: read oid 2 snap -1 2026-02-20T13:10:56.647 INFO:tasks.rados.rados.0.trial114.stdout:396: expect (ObjNum 51 snap 0 seq_num 51) 2026-02-20T13:10:56.647 INFO:tasks.rados.rados.0.trial114.stdout:397: read oid 8 snap -1 2026-02-20T13:10:56.647 INFO:tasks.rados.rados.0.trial114.stdout:397: expect (ObjNum 101 snap 16 seq_num 101) 2026-02-20T13:10:56.647 INFO:tasks.rados.rados.0.trial114.stdout:398: snap_create 2026-02-20T13:10:56.653 INFO:tasks.rados.rados.0.trial114.stdout:393: expect (ObjNum 178 snap 53 seq_num 178) 2026-02-20T13:10:56.660 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1895106 2026-02-20T13:10:56.693 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:56.718 INFO:tasks.rados.rados.0.trial114.stdout:394: expect (ObjNum 124 snap 26 seq_num 124) 2026-02-20T13:10:56.719 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:56.767 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:56.792 INFO:tasks.rados.rados.0.trial114.stdout:395: finishing write tid 1 to trial11441570-24 2026-02-20T13:10:56.792 INFO:tasks.rados.rados.0.trial114.stdout:396: expect (ObjNum 51 snap 0 seq_num 51) 2026-02-20T13:10:56.827 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1394210 2026-02-20T13:10:56.850 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:56.882 INFO:tasks.rados.rados.0.trial114.stdout:397: expect (ObjNum 101 snap 16 seq_num 101) 2026-02-20T13:10:56.915 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1285051 2026-02-20T13:10:56.947 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:10:56.987 INFO:tasks.rados.rados.0.trial114.stdout:395: finishing write tid 2 to trial11441570-24 2026-02-20T13:10:56.987 INFO:tasks.rados.rados.0.trial114.stdout:395: finishing write tid 3 to trial11441570-24 2026-02-20T13:10:56.987 INFO:tasks.rados.rados.0.trial114.stdout:395: finishing write tid 4 to trial11441570-24 2026-02-20T13:10:56.987 INFO:tasks.rados.rados.0.trial114.stdout:395: oid 24 updating version 0 to 142 2026-02-20T13:10:56.988 INFO:tasks.rados.rados.0.trial114.stdout:395: oid 24 version 142 is already newer than 142 2026-02-20T13:10:56.988 INFO:tasks.rados.rados.0.trial114.stdout:395: oid 24 version 142 is already newer than 140 2026-02-20T13:10:56.988 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 24 v 142 (ObjNum 187 snap 56 seq_num 187) dirty exists 2026-02-20T13:10:56.988 INFO:tasks.rados.rados.0.trial114.stdout:395: left oid 24 (ObjNum 187 snap 56 seq_num 187) 2026-02-20T13:10:57.423 INFO:tasks.rados.rados.0.trial114.stdout:393: done (5 left) 2026-02-20T13:10:57.424 INFO:tasks.rados.rados.0.trial114.stdout:394: done (4 left) 2026-02-20T13:10:57.424 INFO:tasks.rados.rados.0.trial114.stdout:395: done (3 left) 2026-02-20T13:10:57.424 INFO:tasks.rados.rados.0.trial114.stdout:396: done (2 left) 2026-02-20T13:10:57.424 INFO:tasks.rados.rados.0.trial114.stdout:397: done (1 left) 2026-02-20T13:10:57.424 INFO:tasks.rados.rados.0.trial114.stdout:398: done (0 left) 2026-02-20T13:10:57.424 INFO:tasks.rados.rados.0.trial114.stdout:399: delete oid 45 current snap is 57 2026-02-20T13:10:57.466 INFO:tasks.rados.rados.0.trial114.stdout:399: done (0 left) 2026-02-20T13:10:57.466 INFO:tasks.rados.rados.0.trial114.stdout:400: snap_remove snap 56 2026-02-20T13:10:58.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2026-02-20T13:10:58.355 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:10:58.425 INFO:tasks.rados.rados.0.trial114.stdout:400: done (0 left) 2026-02-20T13:10:58.425 INFO:tasks.rados.rados.0.trial114.stdout:401: write oid 29 current snap is 57 2026-02-20T13:10:58.425 INFO:tasks.rados.rados.0.trial114.stdout:401: seq_num 189 ranges {776523=614533,1976979=757720} 2026-02-20T13:10:58.430 INFO:tasks.rados.rados.0.trial114.stdout:401: writing trial11441570-29 from 776523 to 1391056 tid 1 2026-02-20T13:10:58.432 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:58.428+0000 7f7e0896f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:58.435 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:10:58.432+0000 7f7e0896f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:10:58.436 INFO:tasks.rados.rados.0.trial114.stdout:401: writing trial11441570-29 from 1976979 to 2734699 tid 2 2026-02-20T13:10:58.436 INFO:tasks.rados.rados.0.trial114.stdout:402: write oid 6 current snap is 57 2026-02-20T13:10:58.436 INFO:tasks.rados.rados.0.trial114.stdout:402: seq_num 190 ranges {793330=689782,2035461=617731,3101545=91785} 2026-02-20T13:10:58.442 INFO:tasks.rados.rados.0.trial114.stdout:402: writing trial11441570-6 from 793330 to 1483112 tid 1 2026-02-20T13:10:58.446 INFO:tasks.rados.rados.0.trial114.stdout:402: writing trial11441570-6 from 2035461 to 2653192 tid 2 2026-02-20T13:10:58.448 INFO:tasks.rados.rados.0.trial114.stdout:402: writing trial11441570-6 from 3101545 to 3193330 tid 3 2026-02-20T13:10:58.448 INFO:tasks.rados.rados.0.trial114.stdout:403: snap_create 2026-02-20T13:10:58.495 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:10:58.496 INFO:tasks.rados.rados.0.trial114.stdout:401: finishing write tid 1 to trial11441570-29 2026-02-20T13:10:58.499 INFO:tasks.rados.rados.0.trial114.stdout:401: finishing write tid 2 to trial11441570-29 2026-02-20T13:10:58.510 INFO:tasks.rados.rados.0.trial114.stdout:401: finishing write tid 3 to trial11441570-29 2026-02-20T13:10:58.512 INFO:tasks.rados.rados.0.trial114.stdout:401: finishing write tid 4 to trial11441570-29 2026-02-20T13:10:58.512 INFO:tasks.rados.rados.0.trial114.stdout:401: oid 29 updating version 0 to 90 2026-02-20T13:10:58.512 INFO:tasks.rados.rados.0.trial114.stdout:401: oid 29 version 90 is already newer than 90 2026-02-20T13:10:58.512 INFO:tasks.rados.rados.0.trial114.stdout:401: oid 29 version 90 is already newer than 90 2026-02-20T13:10:58.513 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 29 v 90 (ObjNum 189 snap 57 seq_num 189) dirty exists 2026-02-20T13:10:58.513 INFO:tasks.rados.rados.0.trial114.stdout:401: left oid 29 (ObjNum 189 snap 57 seq_num 189) 2026-02-20T13:10:58.513 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:10:58.514 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:10:58.518 INFO:tasks.rados.rados.0.trial114.stdout:402: finishing write tid 1 to trial11441570-6 2026-02-20T13:10:58.525 INFO:tasks.rados.rados.0.trial114.stdout:402: finishing write tid 2 to trial11441570-6 2026-02-20T13:10:58.528 INFO:tasks.rados.rados.0.trial114.stdout:402: finishing write tid 3 to trial11441570-6 2026-02-20T13:10:58.531 INFO:tasks.rados.rados.0.trial114.stdout:402: finishing write tid 4 to trial11441570-6 2026-02-20T13:10:58.533 INFO:tasks.rados.rados.0.trial114.stdout:402: finishing write tid 5 to trial11441570-6 2026-02-20T13:10:58.533 INFO:tasks.rados.rados.0.trial114.stdout:402: oid 6 updating version 0 to 95 2026-02-20T13:10:58.533 INFO:tasks.rados.rados.0.trial114.stdout:402: oid 6 version 95 is already newer than 95 2026-02-20T13:10:58.533 INFO:tasks.rados.rados.0.trial114.stdout:402: oid 6 version 95 is already newer than 95 2026-02-20T13:10:58.533 INFO:tasks.rados.rados.0.trial114.stdout:402: oid 6 version 95 is already newer than 95 2026-02-20T13:10:58.533 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 6 v 95 (ObjNum 190 snap 57 seq_num 190) dirty exists 2026-02-20T13:10:58.533 INFO:tasks.rados.rados.0.trial114.stdout:402: left oid 6 (ObjNum 190 snap 57 seq_num 190) 2026-02-20T13:10:59.370 INFO:tasks.rados.rados.0.trial114.stdout:401: done (2 left) 2026-02-20T13:10:59.370 INFO:tasks.rados.rados.0.trial114.stdout:402: done (1 left) 2026-02-20T13:10:59.370 INFO:tasks.rados.rados.0.trial114.stdout:403: done (0 left) 2026-02-20T13:10:59.370 INFO:tasks.rados.rados.0.trial114.stdout:404: write oid 22 current snap is 58 2026-02-20T13:10:59.370 INFO:tasks.rados.rados.0.trial114.stdout:404: seq_num 191 ranges {410137=481384,1410296=761389,2728968=481169} 2026-02-20T13:10:59.373 INFO:tasks.rados.rados.0.trial114.stdout:404: writing trial11441570-22 from 410137 to 891521 tid 1 2026-02-20T13:10:59.379 INFO:tasks.rados.rados.0.trial114.stdout:404: writing trial11441570-22 from 1410296 to 2171685 tid 2 2026-02-20T13:10:59.383 INFO:tasks.rados.rados.0.trial114.stdout:404: writing trial11441570-22 from 2728968 to 3210137 tid 3 2026-02-20T13:10:59.384 INFO:tasks.rados.rados.0.trial114.stdout:405: snap_remove snap 38 2026-02-20T13:11:00.069 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:00.140 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:00.143 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:00.144 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:00.375 INFO:tasks.rados.rados.0.trial114.stdout:405: done (1 left) 2026-02-20T13:11:00.375 INFO:tasks.rados.rados.0.trial114.stdout:406: snap_create 2026-02-20T13:11:00.375 INFO:tasks.rados.rados.0.trial114.stdout:404: finishing write tid 1 to trial11441570-22 2026-02-20T13:11:00.375 INFO:tasks.rados.rados.0.trial114.stdout:404: finishing write tid 2 to trial11441570-22 2026-02-20T13:11:00.376 INFO:tasks.rados.rados.0.trial114.stdout:404: finishing write tid 3 to trial11441570-22 2026-02-20T13:11:00.376 INFO:tasks.rados.rados.0.trial114.stdout:404: finishing write tid 4 to trial11441570-22 2026-02-20T13:11:00.376 INFO:tasks.rados.rados.0.trial114.stdout:404: finishing write tid 5 to trial11441570-22 2026-02-20T13:11:00.376 INFO:tasks.rados.rados.0.trial114.stdout:404: oid 22 updating version 0 to 91 2026-02-20T13:11:00.376 INFO:tasks.rados.rados.0.trial114.stdout:404: oid 22 version 91 is already newer than 91 2026-02-20T13:11:00.376 INFO:tasks.rados.rados.0.trial114.stdout:404: oid 22 version 91 is already newer than 91 2026-02-20T13:11:00.376 INFO:tasks.rados.rados.0.trial114.stdout:404: oid 22 version 91 is already newer than 91 2026-02-20T13:11:00.376 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 22 v 91 (ObjNum 191 snap 58 seq_num 191) dirty exists 2026-02-20T13:11:00.376 INFO:tasks.rados.rados.0.trial114.stdout:404: left oid 22 (ObjNum 191 snap 58 seq_num 191) 2026-02-20T13:11:00.515 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:00.590 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:00.585+0000 7f0d6585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:00.593 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:00.589+0000 7f0d6585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:00.620 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:00.635 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:00.636 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:01.375 INFO:tasks.rados.rados.0.trial114.stdout:404: done (1 left) 2026-02-20T13:11:01.376 INFO:tasks.rados.rados.0.trial114.stdout:406: done (0 left) 2026-02-20T13:11:01.376 INFO:tasks.rados.rados.0.trial114.stdout:407: snap_create 2026-02-20T13:11:02.382 INFO:tasks.rados.rados.0.trial114.stdout:407: done (0 left) 2026-02-20T13:11:02.382 INFO:tasks.rados.rados.0.trial114.stdout:408: snap_remove snap 54 2026-02-20T13:11:02.636 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:02.711 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:02.707+0000 7f6d7785a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:02.714 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:02.710+0000 7f6d7785a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:02.740 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:02.757 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:02.757 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:03.384 INFO:tasks.rados.rados.0.trial114.stdout:408: done (0 left) 2026-02-20T13:11:03.384 INFO:tasks.rados.rados.0.trial114.stdout:409: write oid 46 current snap is 60 2026-02-20T13:11:03.384 INFO:tasks.rados.rados.0.trial114.stdout:409: seq_num 192 ranges {426944=556633,1468778=621400,2872744=354200} 2026-02-20T13:11:03.388 INFO:tasks.rados.rados.0.trial114.stdout:409: writing trial11441570-46 from 426944 to 983577 tid 1 2026-02-20T13:11:03.392 INFO:tasks.rados.rados.0.trial114.stdout:409: writing trial11441570-46 from 1468778 to 2090178 tid 2 2026-02-20T13:11:03.397 INFO:tasks.rados.rados.0.trial114.stdout:409: writing trial11441570-46 from 2872744 to 3226944 tid 3 2026-02-20T13:11:03.397 INFO:tasks.rados.rados.0.trial114.stdout:410: snap_remove snap 44 2026-02-20T13:11:03.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2026-02-20T13:11:04.390 INFO:tasks.rados.rados.0.trial114.stdout:410: done (1 left) 2026-02-20T13:11:04.390 INFO:tasks.rados.rados.0.trial114.stdout:411: delete oid 37 current snap is 60 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: finishing write tid 1 to trial11441570-46 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: finishing write tid 2 to trial11441570-46 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: finishing write tid 3 to trial11441570-46 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: finishing write tid 4 to trial11441570-46 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: finishing write tid 5 to trial11441570-46 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: oid 46 updating version 0 to 89 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: oid 46 version 89 is already newer than 89 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: oid 46 version 89 is already newer than 89 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: oid 46 version 89 is already newer than 89 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 46 v 89 (ObjNum 192 snap 60 seq_num 192) dirty exists 2026-02-20T13:11:04.391 INFO:tasks.rados.rados.0.trial114.stdout:409: left oid 46 (ObjNum 192 snap 60 seq_num 192) 2026-02-20T13:11:04.417 INFO:tasks.rados.rados.0.trial114.stdout:409: done (1 left) 2026-02-20T13:11:04.417 INFO:tasks.rados.rados.0.trial114.stdout:411: done (0 left) 2026-02-20T13:11:04.417 INFO:tasks.rados.rados.0.trial114.stdout:412: delete oid 48 current snap is 60 2026-02-20T13:11:04.422 INFO:tasks.rados.rados.0.trial114.stdout:412: done (0 left) 2026-02-20T13:11:04.423 INFO:tasks.rados.rados.0.trial114.stdout:413: read oid 9 snap -1 2026-02-20T13:11:04.423 INFO:tasks.rados.rados.0.trial114.stdout:413: expect (ObjNum 182 snap 54 seq_num 182) 2026-02-20T13:11:04.423 INFO:tasks.rados.rados.0.trial114.stdout:414: read oid 33 snap 55 2026-02-20T13:11:04.423 INFO:tasks.rados.rados.0.trial114.stdout:414: expect (ObjNum 181 snap 54 seq_num 181) 2026-02-20T13:11:04.423 INFO:tasks.rados.rados.0.trial114.stdout:415: read oid 30 snap -1 2026-02-20T13:11:04.423 INFO:tasks.rados.rados.0.trial114.stdout:415: expect (ObjNum 139 snap 33 seq_num 139) 2026-02-20T13:11:04.423 INFO:tasks.rados.rados.0.trial114.stdout:416: snap_create 2026-02-20T13:11:04.439 INFO:tasks.rados.rados.0.trial114.stdout:413: expect (ObjNum 182 snap 54 seq_num 182) 2026-02-20T13:11:04.462 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:04.488 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:04.514 INFO:tasks.rados.rados.0.trial114.stdout:415: expect (ObjNum 139 snap 33 seq_num 139) 2026-02-20T13:11:04.567 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:04.599 INFO:tasks.rados.rados.0.trial114.stdout:414: expect (ObjNum 181 snap 54 seq_num 181) 2026-02-20T13:11:04.677 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 527812 2026-02-20T13:11:04.758 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:04.835 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:04.830+0000 7f9345e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:04.837 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:04.834+0000 7f9345e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:04.863 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:04.879 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:04.879 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:05.145 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:05.217 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:05.219 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:05.220 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:05.393 INFO:tasks.rados.rados.0.trial114.stdout:413: done (3 left) 2026-02-20T13:11:05.393 INFO:tasks.rados.rados.0.trial114.stdout:414: done (2 left) 2026-02-20T13:11:05.393 INFO:tasks.rados.rados.0.trial114.stdout:415: done (1 left) 2026-02-20T13:11:05.393 INFO:tasks.rados.rados.0.trial114.stdout:416: done (0 left) 2026-02-20T13:11:05.393 INFO:tasks.rados.rados.0.trial114.stdout:417: snap_remove snap 57 2026-02-20T13:11:06.399 INFO:tasks.rados.rados.0.trial114.stdout:417: done (0 left) 2026-02-20T13:11:06.399 INFO:tasks.rados.rados.0.trial114.stdout:418: write (excl) oid 30 current snap is 61 2026-02-20T13:11:06.399 INFO:tasks.rados.rados.0.trial114.stdout:418: seq_num 195 ranges {477365=782380,1927871=768727,3122307=155058} 2026-02-20T13:11:06.404 INFO:tasks.rados.rados.0.trial114.stdout:418: writing trial11441570-30 from 477365 to 1259745 tid 1 2026-02-20T13:11:06.410 INFO:tasks.rados.rados.0.trial114.stdout:418: writing trial11441570-30 from 1927871 to 2696598 tid 2 2026-02-20T13:11:06.413 INFO:tasks.rados.rados.0.trial114.stdout:418: writing trial11441570-30 from 3122307 to 3277365 tid 3 2026-02-20T13:11:06.413 INFO:tasks.rados.rados.0.trial114.stdout:419: snap_create 2026-02-20T13:11:06.442 INFO:tasks.rados.rados.0.trial114.stdout:418: finishing write tid 1 to trial11441570-30 2026-02-20T13:11:06.457 INFO:tasks.rados.rados.0.trial114.stdout:418: finishing write tid 2 to trial11441570-30 2026-02-20T13:11:06.463 INFO:tasks.rados.rados.0.trial114.stdout:418: finishing write tid 3 to trial11441570-30 2026-02-20T13:11:06.469 INFO:tasks.rados.rados.0.trial114.stdout:418: finishing write tid 4 to trial11441570-30 2026-02-20T13:11:06.470 INFO:tasks.rados.rados.0.trial114.stdout:418: finishing write tid 5 to trial11441570-30 2026-02-20T13:11:06.470 INFO:tasks.rados.rados.0.trial114.stdout:418: oid 30 updating version 0 to 161 2026-02-20T13:11:06.471 INFO:tasks.rados.rados.0.trial114.stdout:418: oid 30 version 161 is already newer than 161 2026-02-20T13:11:06.471 INFO:tasks.rados.rados.0.trial114.stdout:418: oid 30 version 161 is already newer than 161 2026-02-20T13:11:06.471 INFO:tasks.rados.rados.0.trial114.stdout:418: oid 30 version 161 is already newer than 158 2026-02-20T13:11:06.471 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 30 v 161 (ObjNum 195 snap 61 seq_num 195) dirty exists 2026-02-20T13:11:06.471 INFO:tasks.rados.rados.0.trial114.stdout:418: left oid 30 (ObjNum 195 snap 61 seq_num 195) 2026-02-20T13:11:06.880 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:06.957 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:06.952+0000 7fd8b885a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:06.959 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:06.955+0000 7fd8b885a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:06.987 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:07.004 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:07.004 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:07.400 INFO:tasks.rados.rados.0.trial114.stdout:418: done (1 left) 2026-02-20T13:11:07.401 INFO:tasks.rados.rados.0.trial114.stdout:419: done (0 left) 2026-02-20T13:11:07.401 INFO:tasks.rados.rados.0.trial114.stdout:420: write (excl) oid 2 current snap is 62 2026-02-20T13:11:07.401 INFO:tasks.rados.rados.0.trial114.stdout:420: seq_num 196 ranges {494172=457629,1586353=512385,2749730=544442} 2026-02-20T13:11:07.404 INFO:tasks.rados.rados.0.trial114.stdout:420: writing trial11441570-2 from 494172 to 951801 tid 1 2026-02-20T13:11:07.409 INFO:tasks.rados.rados.0.trial114.stdout:420: writing trial11441570-2 from 1586353 to 2098738 tid 2 2026-02-20T13:11:07.413 INFO:tasks.rados.rados.0.trial114.stdout:420: writing trial11441570-2 from 2749730 to 3294172 tid 3 2026-02-20T13:11:07.413 INFO:tasks.rados.rados.0.trial114.stdout:421: read oid 35 snap -1 2026-02-20T13:11:07.413 INFO:tasks.rados.rados.0.trial114.stdout:421: expect (ObjNum 115 snap 21 seq_num 115) 2026-02-20T13:11:07.413 INFO:tasks.rados.rados.0.trial114.stdout:422: read oid 7 snap -1 2026-02-20T13:11:07.413 INFO:tasks.rados.rados.0.trial114.stdout:422: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:07.413 INFO:tasks.rados.rados.0.trial114.stdout:423: snap_remove snap 53 2026-02-20T13:11:08.407 INFO:tasks.rados.rados.0.trial114.stdout:423: done (3 left) 2026-02-20T13:11:08.408 INFO:tasks.rados.rados.0.trial114.stdout:424: write (excl) oid 17 current snap is 62 2026-02-20T13:11:08.408 INFO:tasks.rados.rados.0.trial114.stdout:424: seq_num 197 ranges {510979=532878,1528482=772396,3060800=250179} 2026-02-20T13:11:08.411 INFO:tasks.rados.rados.0.trial114.stdout:424: writing trial11441570-17 from 510979 to 1043857 tid 1 2026-02-20T13:11:08.416 INFO:tasks.rados.rados.0.trial114.stdout:424: writing trial11441570-17 from 1528482 to 2300878 tid 2 2026-02-20T13:11:08.420 INFO:tasks.rados.rados.0.trial114.stdout:424: writing trial11441570-17 from 3060800 to 3310979 tid 3 2026-02-20T13:11:08.420 INFO:tasks.rados.rados.0.trial114.stdout:425: snap_create 2026-02-20T13:11:08.420 INFO:tasks.rados.rados.0.trial114.stdout:422: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:08.438 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:08.468 INFO:tasks.rados.rados.0.trial114.stdout:420: finishing write tid 1 to trial11441570-2 2026-02-20T13:11:08.468 INFO:tasks.rados.rados.0.trial114.stdout:421: expect (ObjNum 115 snap 21 seq_num 115) 2026-02-20T13:11:08.645 INFO:tasks.rados.rados.0.trial114.stdout:420: finishing write tid 2 to trial11441570-2 2026-02-20T13:11:08.645 INFO:tasks.rados.rados.0.trial114.stdout:420: finishing write tid 3 to trial11441570-2 2026-02-20T13:11:08.645 INFO:tasks.rados.rados.0.trial114.stdout:420: finishing write tid 4 to trial11441570-2 2026-02-20T13:11:08.645 INFO:tasks.rados.rados.0.trial114.stdout:420: finishing write tid 5 to trial11441570-2 2026-02-20T13:11:08.645 INFO:tasks.rados.rados.0.trial114.stdout:420: oid 2 updating version 0 to 18 2026-02-20T13:11:08.646 INFO:tasks.rados.rados.0.trial114.stdout:420: oid 2 version 18 is already newer than 15 2026-02-20T13:11:08.646 INFO:tasks.rados.rados.0.trial114.stdout:420: oid 2 version 18 is already newer than 18 2026-02-20T13:11:08.646 INFO:tasks.rados.rados.0.trial114.stdout:420: oid 2 version 18 is already newer than 18 2026-02-20T13:11:08.646 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 2 v 18 (ObjNum 196 snap 62 seq_num 196) dirty exists 2026-02-20T13:11:08.646 INFO:tasks.rados.rados.0.trial114.stdout:420: left oid 2 (ObjNum 196 snap 62 seq_num 196) 2026-02-20T13:11:08.646 INFO:tasks.rados.rados.0.trial114.stdout:424: finishing write tid 1 to trial11441570-17 2026-02-20T13:11:08.646 INFO:tasks.rados.rados.0.trial114.stdout:424: finishing write tid 2 to trial11441570-17 2026-02-20T13:11:08.646 INFO:tasks.rados.rados.0.trial114.stdout:424: finishing write tid 3 to trial11441570-17 2026-02-20T13:11:08.646 INFO:tasks.rados.rados.0.trial114.stdout:424: finishing write tid 4 to trial11441570-17 2026-02-20T13:11:08.647 INFO:tasks.rados.rados.0.trial114.stdout:424: finishing write tid 5 to trial11441570-17 2026-02-20T13:11:08.647 INFO:tasks.rados.rados.0.trial114.stdout:424: oid 17 updating version 0 to 49 2026-02-20T13:11:08.647 INFO:tasks.rados.rados.0.trial114.stdout:424: oid 17 version 49 is already newer than 46 2026-02-20T13:11:08.647 INFO:tasks.rados.rados.0.trial114.stdout:424: oid 17 version 49 is already newer than 49 2026-02-20T13:11:08.647 INFO:tasks.rados.rados.0.trial114.stdout:424: oid 17 version 49 is already newer than 49 2026-02-20T13:11:08.647 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 17 v 49 (ObjNum 197 snap 62 seq_num 197) dirty exists 2026-02-20T13:11:08.647 INFO:tasks.rados.rados.0.trial114.stdout:424: left oid 17 (ObjNum 197 snap 62 seq_num 197) 2026-02-20T13:11:09.005 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:09.081 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:09.078+0000 7fef28d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:09.084 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:09.081+0000 7fef28d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:09.111 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:09.127 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:09.128 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:09.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2026-02-20T13:11:09.373 INFO:tasks.rados.rados.0.trial114.stdout:420: done (4 left) 2026-02-20T13:11:09.373 INFO:tasks.rados.rados.0.trial114.stdout:421: done (3 left) 2026-02-20T13:11:09.373 INFO:tasks.rados.rados.0.trial114.stdout:422: done (2 left) 2026-02-20T13:11:09.373 INFO:tasks.rados.rados.0.trial114.stdout:424: done (1 left) 2026-02-20T13:11:09.373 INFO:tasks.rados.rados.0.trial114.stdout:425: done (0 left) 2026-02-20T13:11:09.373 INFO:tasks.rados.rados.0.trial114.stdout:426: read oid 7 snap -1 2026-02-20T13:11:09.373 INFO:tasks.rados.rados.0.trial114.stdout:426: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:09.373 INFO:tasks.rados.rados.0.trial114.stdout:427: write oid 10 current snap is 63 2026-02-20T13:11:09.373 INFO:tasks.rados.rados.0.trial114.stdout:427: seq_num 198 ranges {527786=724480,1703317=516054,2804576=435035} 2026-02-20T13:11:09.378 INFO:tasks.rados.rados.0.trial114.stdout:427: writing trial11441570-10 from 527786 to 1252266 tid 1 2026-02-20T13:11:09.382 INFO:tasks.rados.rados.0.trial114.stdout:427: writing trial11441570-10 from 1703317 to 2219371 tid 2 2026-02-20T13:11:09.386 INFO:tasks.rados.rados.0.trial114.stdout:427: writing trial11441570-10 from 2804576 to 3239611 tid 3 2026-02-20T13:11:09.386 INFO:tasks.rados.rados.0.trial114.stdout:428: write (excl) oid 38 current snap is 63 2026-02-20T13:11:09.386 INFO:tasks.rados.rados.0.trial114.stdout:428: seq_num 199 ranges {544593=799729,1761799=776065,2948352=396241} 2026-02-20T13:11:09.391 INFO:tasks.rados.rados.0.trial114.stdout:428: writing trial11441570-38 from 544593 to 1344322 tid 1 2026-02-20T13:11:09.395 INFO:tasks.rados.rados.0.trial114.stdout:428: writing trial11441570-38 from 1761799 to 2537864 tid 2 2026-02-20T13:11:09.398 INFO:tasks.rados.rados.0.trial114.stdout:428: writing trial11441570-38 from 2948352 to 3344593 tid 3 2026-02-20T13:11:09.398 INFO:tasks.rados.rados.0.trial114.stdout:429: write (excl) oid 26 current snap is 63 2026-02-20T13:11:09.399 INFO:tasks.rados.rados.0.trial114.stdout:429: seq_num 200 ranges {561400=474978,1820281=519723,2859422=457579} 2026-02-20T13:11:09.402 INFO:tasks.rados.rados.0.trial114.stdout:429: writing trial11441570-26 from 561400 to 1036378 tid 1 2026-02-20T13:11:09.407 INFO:tasks.rados.rados.0.trial114.stdout:429: writing trial11441570-26 from 1820281 to 2340004 tid 2 2026-02-20T13:11:09.411 INFO:tasks.rados.rados.0.trial114.stdout:429: writing trial11441570-26 from 2859422 to 3317001 tid 3 2026-02-20T13:11:09.411 INFO:tasks.rados.rados.0.trial114.stdout:430: read oid 22 snap -1 2026-02-20T13:11:09.411 INFO:tasks.rados.rados.0.trial114.stdout:430: expect (ObjNum 191 snap 58 seq_num 191) 2026-02-20T13:11:09.411 INFO:tasks.rados.rados.0.trial114.stdout:431: delete oid 21 current snap is 63 2026-02-20T13:11:09.411 INFO:tasks.rados.rados.0.trial114.stdout:426: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:09.447 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:09.465 INFO:tasks.rados.rados.0.trial114.stdout:430: expect (ObjNum 191 snap 58 seq_num 191) 2026-02-20T13:11:09.530 INFO:tasks.rados.rados.0.trial114.stdout:427: finishing write tid 1 to trial11441570-10 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:429: finishing write tid 1 to trial11441570-26 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:427: finishing write tid 2 to trial11441570-10 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:427: finishing write tid 3 to trial11441570-10 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:429: finishing write tid 2 to trial11441570-26 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:426: done (5 left) 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:430: done (4 left) 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:431: done (3 left) 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:432: delete oid 50 current snap is 63 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:427: finishing write tid 4 to trial11441570-10 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:429: finishing write tid 3 to trial11441570-26 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:427: finishing write tid 5 to trial11441570-10 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:427: oid 10 updating version 0 to 81 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:427: oid 10 version 81 is already newer than 81 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:427: oid 10 version 81 is already newer than 81 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:427: oid 10 version 81 is already newer than 81 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 10 v 81 (ObjNum 198 snap 63 seq_num 198) dirty exists 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:427: left oid 10 (ObjNum 198 snap 63 seq_num 198) 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:429: finishing write tid 4 to trial11441570-26 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:429: finishing write tid 5 to trial11441570-26 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:429: oid 26 updating version 0 to 54 2026-02-20T13:11:09.531 INFO:tasks.rados.rados.0.trial114.stdout:429: oid 26 updating version 54 to 57 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:429: oid 26 version 57 is already newer than 57 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:429: oid 26 version 57 is already newer than 57 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 26 v 57 (ObjNum 200 snap 63 seq_num 200) dirty exists 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:429: left oid 26 (ObjNum 200 snap 63 seq_num 200) 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: finishing write tid 1 to trial11441570-38 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: finishing write tid 2 to trial11441570-38 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: finishing write tid 3 to trial11441570-38 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: finishing write tid 4 to trial11441570-38 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: finishing write tid 5 to trial11441570-38 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: oid 38 updating version 0 to 94 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: oid 38 version 94 is already newer than 91 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: oid 38 version 94 is already newer than 94 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: oid 38 version 94 is already newer than 94 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 38 v 94 (ObjNum 199 snap 63 seq_num 199) dirty exists 2026-02-20T13:11:09.532 INFO:tasks.rados.rados.0.trial114.stdout:428: left oid 38 (ObjNum 199 snap 63 seq_num 199) 2026-02-20T13:11:09.559 INFO:tasks.rados.rados.0.trial114.stdout:427: done (3 left) 2026-02-20T13:11:09.559 INFO:tasks.rados.rados.0.trial114.stdout:428: done (2 left) 2026-02-20T13:11:09.559 INFO:tasks.rados.rados.0.trial114.stdout:429: done (1 left) 2026-02-20T13:11:09.559 INFO:tasks.rados.rados.0.trial114.stdout:432: done (0 left) 2026-02-20T13:11:09.559 INFO:tasks.rados.rados.0.trial114.stdout:433: delete oid 5 current snap is 63 2026-02-20T13:11:09.584 INFO:tasks.rados.rados.0.trial114.stdout:433: done (0 left) 2026-02-20T13:11:09.584 INFO:tasks.rados.rados.0.trial114.stdout:434: read oid 42 snap -1 2026-02-20T13:11:09.584 INFO:tasks.rados.rados.0.trial114.stdout:434: expect (ObjNum 66 snap 5 seq_num 66) 2026-02-20T13:11:09.584 INFO:tasks.rados.rados.0.trial114.stdout:435: read oid 30 snap -1 2026-02-20T13:11:09.584 INFO:tasks.rados.rados.0.trial114.stdout:435: expect (ObjNum 195 snap 61 seq_num 195) 2026-02-20T13:11:09.584 INFO:tasks.rados.rados.0.trial114.stdout:436: read oid 34 snap 55 2026-02-20T13:11:09.585 INFO:tasks.rados.rados.0.trial114.stdout:436: expect (ObjNum 146 snap 35 seq_num 146) 2026-02-20T13:11:09.585 INFO:tasks.rados.rados.0.trial114.stdout:437: write oid 45 current snap is 63 2026-02-20T13:11:09.585 INFO:tasks.rados.rados.0.trial114.stdout:437: seq_num 204 ranges {628628=775974,1937856=527061,3252761=175867} 2026-02-20T13:11:09.590 INFO:tasks.rados.rados.0.trial114.stdout:437: writing trial11441570-45 from 628628 to 1404602 tid 1 2026-02-20T13:11:09.594 INFO:tasks.rados.rados.0.trial114.stdout:437: writing trial11441570-45 from 1937856 to 2464917 tid 2 2026-02-20T13:11:09.598 INFO:tasks.rados.rados.0.trial114.stdout:437: writing trial11441570-45 from 3252761 to 3428628 tid 3 2026-02-20T13:11:09.598 INFO:tasks.rados.rados.0.trial114.stdout:438: read oid 46 snap -1 2026-02-20T13:11:09.598 INFO:tasks.rados.rados.0.trial114.stdout:438: expect (ObjNum 192 snap 60 seq_num 192) 2026-02-20T13:11:09.598 INFO:tasks.rados.rados.0.trial114.stdout:439: read oid 48 snap -1 2026-02-20T13:11:09.598 INFO:tasks.rados.rados.0.trial114.stdout:439: expect deleted 2026-02-20T13:11:09.598 INFO:tasks.rados.rados.0.trial114.stdout:440: snap_create 2026-02-20T13:11:09.598 INFO:tasks.rados.rados.0.trial114.stdout:436: expect (ObjNum 146 snap 35 seq_num 146) 2026-02-20T13:11:09.665 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1510264 2026-02-20T13:11:09.685 INFO:tasks.rados.rados.0.trial114.stdout:434: expect (ObjNum 66 snap 5 seq_num 66) 2026-02-20T13:11:09.712 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:09.764 INFO:tasks.rados.rados.0.trial114.stdout:438: expect (ObjNum 192 snap 60 seq_num 192) 2026-02-20T13:11:09.771 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1259262 2026-02-20T13:11:09.814 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1759162 2026-02-20T13:11:09.841 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 45932 2026-02-20T13:11:09.885 INFO:tasks.rados.rados.0.trial114.stdout:437: finishing write tid 1 to trial11441570-45 2026-02-20T13:11:09.885 INFO:tasks.rados.rados.0.trial114.stdout:437: finishing write tid 2 to trial11441570-45 2026-02-20T13:11:09.885 INFO:tasks.rados.rados.0.trial114.stdout:437: finishing write tid 3 to trial11441570-45 2026-02-20T13:11:09.885 INFO:tasks.rados.rados.0.trial114.stdout:435: expect (ObjNum 195 snap 61 seq_num 195) 2026-02-20T13:11:10.030 INFO:tasks.rados.rados.0.trial114.stdout:437: finishing write tid 4 to trial11441570-45 2026-02-20T13:11:10.030 INFO:tasks.rados.rados.0.trial114.stdout:437: finishing write tid 5 to trial11441570-45 2026-02-20T13:11:10.030 INFO:tasks.rados.rados.0.trial114.stdout:437: oid 45 updating version 0 to 171 2026-02-20T13:11:10.030 INFO:tasks.rados.rados.0.trial114.stdout:437: oid 45 version 171 is already newer than 171 2026-02-20T13:11:10.030 INFO:tasks.rados.rados.0.trial114.stdout:437: oid 45 version 171 is already newer than 171 2026-02-20T13:11:10.030 INFO:tasks.rados.rados.0.trial114.stdout:437: oid 45 version 171 is already newer than 171 2026-02-20T13:11:10.031 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 45 v 171 (ObjNum 204 snap 63 seq_num 204) dirty exists 2026-02-20T13:11:10.031 INFO:tasks.rados.rados.0.trial114.stdout:437: left oid 45 (ObjNum 204 snap 63 seq_num 204) 2026-02-20T13:11:10.221 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:10.294 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:10.297 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:10.297 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:10.411 INFO:tasks.rados.rados.0.trial114.stdout:434: done (6 left) 2026-02-20T13:11:10.412 INFO:tasks.rados.rados.0.trial114.stdout:435: done (5 left) 2026-02-20T13:11:10.412 INFO:tasks.rados.rados.0.trial114.stdout:436: done (4 left) 2026-02-20T13:11:10.412 INFO:tasks.rados.rados.0.trial114.stdout:437: done (3 left) 2026-02-20T13:11:10.412 INFO:tasks.rados.rados.0.trial114.stdout:438: done (2 left) 2026-02-20T13:11:10.412 INFO:tasks.rados.rados.0.trial114.stdout:439: done (1 left) 2026-02-20T13:11:10.412 INFO:tasks.rados.rados.0.trial114.stdout:440: done (0 left) 2026-02-20T13:11:10.412 INFO:tasks.rados.rados.0.trial114.stdout:441: write (excl) oid 37 current snap is 64 2026-02-20T13:11:10.412 INFO:tasks.rados.rados.0.trial114.stdout:441: seq_num 205 ranges {645435=451223,1879985=787072,3280184=165251} 2026-02-20T13:11:10.415 INFO:tasks.rados.rados.0.trial114.stdout:441: writing trial11441570-37 from 645435 to 1096658 tid 1 2026-02-20T13:11:10.421 INFO:tasks.rados.rados.0.trial114.stdout:441: writing trial11441570-37 from 1879985 to 2667057 tid 2 2026-02-20T13:11:10.424 INFO:tasks.rados.rados.0.trial114.stdout:441: writing trial11441570-37 from 3280184 to 3445435 tid 3 2026-02-20T13:11:10.424 INFO:tasks.rados.rados.0.trial114.stdout:442: snap_create 2026-02-20T13:11:10.440 INFO:tasks.rados.rados.0.trial114.stdout:441: finishing write tid 1 to trial11441570-37 2026-02-20T13:11:10.453 INFO:tasks.rados.rados.0.trial114.stdout:441: finishing write tid 2 to trial11441570-37 2026-02-20T13:11:10.460 INFO:tasks.rados.rados.0.trial114.stdout:441: finishing write tid 3 to trial11441570-37 2026-02-20T13:11:10.463 INFO:tasks.rados.rados.0.trial114.stdout:441: finishing write tid 4 to trial11441570-37 2026-02-20T13:11:10.464 INFO:tasks.rados.rados.0.trial114.stdout:441: finishing write tid 5 to trial11441570-37 2026-02-20T13:11:10.465 INFO:tasks.rados.rados.0.trial114.stdout:441: oid 37 updating version 0 to 158 2026-02-20T13:11:10.465 INFO:tasks.rados.rados.0.trial114.stdout:441: oid 37 version 158 is already newer than 158 2026-02-20T13:11:10.465 INFO:tasks.rados.rados.0.trial114.stdout:441: oid 37 version 158 is already newer than 155 2026-02-20T13:11:10.465 INFO:tasks.rados.rados.0.trial114.stdout:441: oid 37 version 158 is already newer than 158 2026-02-20T13:11:10.465 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 37 v 158 (ObjNum 205 snap 64 seq_num 205) dirty exists 2026-02-20T13:11:10.465 INFO:tasks.rados.rados.0.trial114.stdout:441: left oid 37 (ObjNum 205 snap 64 seq_num 205) 2026-02-20T13:11:11.128 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:11.207 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:11.203+0000 7f0d2c2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:11.209 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:11.207+0000 7f0d2c2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:11.235 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:11.250 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:11.251 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:11.413 INFO:tasks.rados.rados.0.trial114.stdout:441: done (1 left) 2026-02-20T13:11:11.413 INFO:tasks.rados.rados.0.trial114.stdout:442: done (0 left) 2026-02-20T13:11:11.414 INFO:tasks.rados.rados.0.trial114.stdout:443: delete oid 4 current snap is 65 2026-02-20T13:11:11.455 INFO:tasks.rados.rados.0.trial114.stdout:443: done (0 left) 2026-02-20T13:11:11.455 INFO:tasks.rados.rados.0.trial114.stdout:444: delete oid 1 current snap is 65 2026-02-20T13:11:11.485 INFO:tasks.rados.rados.0.trial114.stdout:444: done (0 left) 2026-02-20T13:11:11.485 INFO:tasks.rados.rados.0.trial114.stdout:445: read oid 41 snap 48 2026-02-20T13:11:11.485 INFO:tasks.rados.rados.0.trial114.stdout:445: expect (ObjNum 67 snap 5 seq_num 67) 2026-02-20T13:11:11.485 INFO:tasks.rados.rados.0.trial114.stdout:446: write oid 3 current snap is 65 2026-02-20T13:11:11.485 INFO:tasks.rados.rados.0.trial114.stdout:446: seq_num 208 ranges {695856=793323,2171784=534399,3362453=133403} 2026-02-20T13:11:11.490 INFO:tasks.rados.rados.0.trial114.stdout:446: writing trial11441570-3 from 695856 to 1489179 tid 1 2026-02-20T13:11:11.495 INFO:tasks.rados.rados.0.trial114.stdout:446: writing trial11441570-3 from 2171784 to 2706183 tid 2 2026-02-20T13:11:11.498 INFO:tasks.rados.rados.0.trial114.stdout:446: writing trial11441570-3 from 3362453 to 3495856 tid 3 2026-02-20T13:11:11.498 INFO:tasks.rados.rados.0.trial114.stdout:447: write oid 47 current snap is 65 2026-02-20T13:11:11.499 INFO:tasks.rados.rados.0.trial114.stdout:447: seq_num 209 ranges {712663=468572,1713913=678057,2873523=591733} 2026-02-20T13:11:11.503 INFO:tasks.rados.rados.0.trial114.stdout:447: writing trial11441570-47 from 712663 to 1181235 tid 1 2026-02-20T13:11:11.507 INFO:tasks.rados.rados.0.trial114.stdout:447: writing trial11441570-47 from 1713913 to 2391970 tid 2 2026-02-20T13:11:11.512 INFO:tasks.rados.rados.0.trial114.stdout:447: writing trial11441570-47 from 2873523 to 3465256 tid 3 2026-02-20T13:11:11.512 INFO:tasks.rados.rados.0.trial114.stdout:448: snap_create 2026-02-20T13:11:11.512 INFO:tasks.rados.rados.0.trial114.stdout:445: expect (ObjNum 67 snap 5 seq_num 67) 2026-02-20T13:11:11.554 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2027516 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: finishing write tid 1 to trial11441570-3 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: finishing write tid 1 to trial11441570-47 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: finishing write tid 2 to trial11441570-3 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: finishing write tid 2 to trial11441570-47 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: finishing write tid 3 to trial11441570-3 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: finishing write tid 3 to trial11441570-47 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: finishing write tid 4 to trial11441570-3 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: finishing write tid 4 to trial11441570-47 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: finishing write tid 5 to trial11441570-47 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: oid 47 updating version 0 to 29 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: oid 47 version 29 is already newer than 29 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: oid 47 version 29 is already newer than 29 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: oid 47 version 29 is already newer than 29 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 47 v 29 (ObjNum 209 snap 65 seq_num 209) dirty exists 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:447: left oid 47 (ObjNum 209 snap 65 seq_num 209) 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: finishing write tid 5 to trial11441570-3 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: oid 3 updating version 0 to 85 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: oid 3 version 85 is already newer than 85 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: oid 3 version 85 is already newer than 85 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: oid 3 version 85 is already newer than 85 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 3 v 85 (ObjNum 208 snap 65 seq_num 208) dirty exists 2026-02-20T13:11:11.612 INFO:tasks.rados.rados.0.trial114.stdout:446: left oid 3 (ObjNum 208 snap 65 seq_num 208) 2026-02-20T13:11:12.418 INFO:tasks.rados.rados.0.trial114.stdout:445: done (3 left) 2026-02-20T13:11:12.418 INFO:tasks.rados.rados.0.trial114.stdout:446: done (2 left) 2026-02-20T13:11:12.418 INFO:tasks.rados.rados.0.trial114.stdout:447: done (1 left) 2026-02-20T13:11:12.418 INFO:tasks.rados.rados.0.trial114.stdout:448: done (0 left) 2026-02-20T13:11:12.418 INFO:tasks.rados.rados.0.trial114.stdout:449: delete oid 13 current snap is 66 2026-02-20T13:11:12.439 INFO:tasks.rados.rados.0.trial114.stdout:449: done (0 left) 2026-02-20T13:11:12.440 INFO:tasks.rados.rados.0.trial114.stdout:450: delete oid 48 current snap is 66 2026-02-20T13:11:12.442 INFO:tasks.rados.rados.0.trial114.stdout:450: done (0 left) 2026-02-20T13:11:12.442 INFO:tasks.rados.rados.0.trial114.stdout:451: read oid 40 snap -1 2026-02-20T13:11:12.442 INFO:tasks.rados.rados.0.trial114.stdout:451: expect (ObjNum 90 snap 16 seq_num 90) 2026-02-20T13:11:12.442 INFO:tasks.rados.rados.0.trial114.stdout:452: read oid 9 snap -1 2026-02-20T13:11:12.442 INFO:tasks.rados.rados.0.trial114.stdout:452: expect (ObjNum 182 snap 54 seq_num 182) 2026-02-20T13:11:12.442 INFO:tasks.rados.rados.0.trial114.stdout:453: write (excl) oid 24 current snap is 66 2026-02-20T13:11:12.442 INFO:tasks.rados.rados.0.trial114.stdout:453: seq_num 212 ranges {763084=694319,1889359=541737,2955792=541902} 2026-02-20T13:11:12.447 INFO:tasks.rados.rados.0.trial114.stdout:453: writing trial11441570-24 from 763084 to 1457403 tid 1 2026-02-20T13:11:12.452 INFO:tasks.rados.rados.0.trial114.stdout:453: writing trial11441570-24 from 1889359 to 2431096 tid 2 2026-02-20T13:11:12.457 INFO:tasks.rados.rados.0.trial114.stdout:453: writing trial11441570-24 from 2955792 to 3497694 tid 3 2026-02-20T13:11:12.457 INFO:tasks.rados.rados.0.trial114.stdout:454: delete oid 16 current snap is 66 2026-02-20T13:11:12.458 INFO:tasks.rados.rados.0.trial114.stdout:452: expect (ObjNum 182 snap 54 seq_num 182) 2026-02-20T13:11:12.507 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2826120 2026-02-20T13:11:12.513 INFO:tasks.rados.rados.0.trial114.stdout:452: done (3 left) 2026-02-20T13:11:12.513 INFO:tasks.rados.rados.0.trial114.stdout:454: done (2 left) 2026-02-20T13:11:12.513 INFO:tasks.rados.rados.0.trial114.stdout:455: read oid 48 snap 60 2026-02-20T13:11:12.513 INFO:tasks.rados.rados.0.trial114.stdout:455: expect deleted 2026-02-20T13:11:12.513 INFO:tasks.rados.rados.0.trial114.stdout:456: snap_create 2026-02-20T13:11:12.513 INFO:tasks.rados.rados.0.trial114.stdout:453: finishing write tid 1 to trial11441570-24 2026-02-20T13:11:12.514 INFO:tasks.rados.rados.0.trial114.stdout:451: expect (ObjNum 90 snap 16 seq_num 90) 2026-02-20T13:11:12.543 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 549282 2026-02-20T13:11:12.619 INFO:tasks.rados.rados.0.trial114.stdout:453: finishing write tid 2 to trial11441570-24 2026-02-20T13:11:12.619 INFO:tasks.rados.rados.0.trial114.stdout:453: finishing write tid 3 to trial11441570-24 2026-02-20T13:11:12.620 INFO:tasks.rados.rados.0.trial114.stdout:453: finishing write tid 4 to trial11441570-24 2026-02-20T13:11:12.620 INFO:tasks.rados.rados.0.trial114.stdout:453: finishing write tid 5 to trial11441570-24 2026-02-20T13:11:12.620 INFO:tasks.rados.rados.0.trial114.stdout:453: oid 24 updating version 0 to 177 2026-02-20T13:11:12.620 INFO:tasks.rados.rados.0.trial114.stdout:453: oid 24 updating version 177 to 180 2026-02-20T13:11:12.620 INFO:tasks.rados.rados.0.trial114.stdout:453: oid 24 version 180 is already newer than 180 2026-02-20T13:11:12.620 INFO:tasks.rados.rados.0.trial114.stdout:453: oid 24 version 180 is already newer than 180 2026-02-20T13:11:12.620 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 24 v 180 (ObjNum 212 snap 66 seq_num 212) dirty exists 2026-02-20T13:11:12.620 INFO:tasks.rados.rados.0.trial114.stdout:453: left oid 24 (ObjNum 212 snap 66 seq_num 212) 2026-02-20T13:11:13.251 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:13.329 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:13.326+0000 7fd18090b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:13.332 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:13.329+0000 7fd18090b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:13.359 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:13.376 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:13.376 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:13.418 INFO:tasks.rados.rados.0.trial114.stdout:451: done (3 left) 2026-02-20T13:11:13.419 INFO:tasks.rados.rados.0.trial114.stdout:453: done (2 left) 2026-02-20T13:11:13.419 INFO:tasks.rados.rados.0.trial114.stdout:455: done (1 left) 2026-02-20T13:11:13.419 INFO:tasks.rados.rados.0.trial114.stdout:456: done (0 left) 2026-02-20T13:11:13.419 INFO:tasks.rados.rados.0.trial114.stdout:457: snap_remove snap 55 2026-02-20T13:11:14.425 INFO:tasks.rados.rados.0.trial114.stdout:457: done (0 left) 2026-02-20T13:11:14.425 INFO:tasks.rados.rados.0.trial114.stdout:458: read oid 39 snap -1 2026-02-20T13:11:14.425 INFO:tasks.rados.rados.0.trial114.stdout:458: expect (ObjNum 143 snap 34 seq_num 143) 2026-02-20T13:11:14.425 INFO:tasks.rados.rados.0.trial114.stdout:459: snap_remove snap 65 2026-02-20T13:11:14.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~110s 2026-02-20T13:11:15.298 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:15.371 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:15.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:15.374 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:15.377 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:15.425 INFO:tasks.rados.rados.0.trial114.stdout:459: done (1 left) 2026-02-20T13:11:15.426 INFO:tasks.rados.rados.0.trial114.stdout:460: write oid 34 current snap is 67 2026-02-20T13:11:15.426 INFO:tasks.rados.rados.0.trial114.stdout:460: seq_num 214 ranges {796698=561170,2006323=545406,3126991=469707} 2026-02-20T13:11:15.431 INFO:tasks.rados.rados.0.trial114.stdout:460: writing trial11441570-34 from 796698 to 1357868 tid 1 2026-02-20T13:11:15.435 INFO:tasks.rados.rados.0.trial114.stdout:460: writing trial11441570-34 from 2006323 to 2551729 tid 2 2026-02-20T13:11:15.440 INFO:tasks.rados.rados.0.trial114.stdout:460: writing trial11441570-34 from 3126991 to 3596698 tid 3 2026-02-20T13:11:15.440 INFO:tasks.rados.rados.0.trial114.stdout:461: delete oid 33 current snap is 67 2026-02-20T13:11:15.440 INFO:tasks.rados.rados.0.trial114.stdout:458: expect (ObjNum 143 snap 34 seq_num 143) 2026-02-20T13:11:15.457 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:15.454+0000 7fb2bb57b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:15.460 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:15.457+0000 7fb2bb57b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:15.483 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1290110 2026-02-20T13:11:15.523 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:15.540 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:15.541 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:15.544 INFO:tasks.rados.rados.0.trial114.stdout:458: done (2 left) 2026-02-20T13:11:15.544 INFO:tasks.rados.rados.0.trial114.stdout:461: done (1 left) 2026-02-20T13:11:15.544 INFO:tasks.rados.rados.0.trial114.stdout:462: read oid 17 snap -1 2026-02-20T13:11:15.544 INFO:tasks.rados.rados.0.trial114.stdout:462: expect (ObjNum 197 snap 62 seq_num 197) 2026-02-20T13:11:15.544 INFO:tasks.rados.rados.0.trial114.stdout:463: read oid 10 snap -1 2026-02-20T13:11:15.544 INFO:tasks.rados.rados.0.trial114.stdout:463: expect (ObjNum 198 snap 63 seq_num 198) 2026-02-20T13:11:15.544 INFO:tasks.rados.rados.0.trial114.stdout:464: snap_remove snap 60 2026-02-20T13:11:16.432 INFO:tasks.rados.rados.0.trial114.stdout:464: done (3 left) 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:465: read oid 31 snap -1 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:465: expect (ObjNum 172 snap 46 seq_num 172) 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:466: snap_create 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:460: finishing write tid 1 to trial11441570-34 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:460: finishing write tid 2 to trial11441570-34 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:460: finishing write tid 3 to trial11441570-34 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:460: finishing write tid 4 to trial11441570-34 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:460: finishing write tid 5 to trial11441570-34 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:460: oid 34 updating version 0 to 90 2026-02-20T13:11:16.433 INFO:tasks.rados.rados.0.trial114.stdout:460: oid 34 version 90 is already newer than 90 2026-02-20T13:11:16.434 INFO:tasks.rados.rados.0.trial114.stdout:460: oid 34 version 90 is already newer than 90 2026-02-20T13:11:16.434 INFO:tasks.rados.rados.0.trial114.stdout:460: oid 34 version 90 is already newer than 90 2026-02-20T13:11:16.434 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 34 v 90 (ObjNum 214 snap 67 seq_num 214) dirty exists 2026-02-20T13:11:16.434 INFO:tasks.rados.rados.0.trial114.stdout:460: left oid 34 (ObjNum 214 snap 67 seq_num 214) 2026-02-20T13:11:16.434 INFO:tasks.rados.rados.0.trial114.stdout:463: expect (ObjNum 198 snap 63 seq_num 198) 2026-02-20T13:11:16.447 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2432700 2026-02-20T13:11:16.471 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:16.569 INFO:tasks.rados.rados.0.trial114.stdout:462: expect (ObjNum 197 snap 62 seq_num 197) 2026-02-20T13:11:16.574 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1022194 2026-02-20T13:11:16.690 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1812416 2026-02-20T13:11:16.726 INFO:tasks.rados.rados.0.trial114.stdout:465: expect (ObjNum 172 snap 46 seq_num 172) 2026-02-20T13:11:16.788 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:17.436 INFO:tasks.rados.rados.0.trial114.stdout:460: done (4 left) 2026-02-20T13:11:17.436 INFO:tasks.rados.rados.0.trial114.stdout:462: done (3 left) 2026-02-20T13:11:17.436 INFO:tasks.rados.rados.0.trial114.stdout:463: done (2 left) 2026-02-20T13:11:17.437 INFO:tasks.rados.rados.0.trial114.stdout:465: done (1 left) 2026-02-20T13:11:17.437 INFO:tasks.rados.rados.0.trial114.stdout:466: done (0 left) 2026-02-20T13:11:17.437 INFO:tasks.rados.rados.0.trial114.stdout:467: read oid 45 snap -1 2026-02-20T13:11:17.437 INFO:tasks.rados.rados.0.trial114.stdout:467: expect (ObjNum 204 snap 63 seq_num 204) 2026-02-20T13:11:17.437 INFO:tasks.rados.rados.0.trial114.stdout:468: snap_remove snap 50 2026-02-20T13:11:17.542 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:17.618 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:17.614+0000 7f2d97762640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:17.620 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:17.617+0000 7f2d97762640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:17.649 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:17.666 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:17.666 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:18.440 INFO:tasks.rados.rados.0.trial114.stdout:468: done (1 left) 2026-02-20T13:11:18.440 INFO:tasks.rados.rados.0.trial114.stdout:469: delete oid 38 current snap is 68 2026-02-20T13:11:18.441 INFO:tasks.rados.rados.0.trial114.stdout:467: expect (ObjNum 204 snap 63 seq_num 204) 2026-02-20T13:11:18.474 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1322163 2026-02-20T13:11:18.522 INFO:tasks.rados.rados.0.trial114.stdout:467: done (1 left) 2026-02-20T13:11:18.522 INFO:tasks.rados.rados.0.trial114.stdout:469: done (0 left) 2026-02-20T13:11:18.522 INFO:tasks.rados.rados.0.trial114.stdout:470: write (excl) oid 20 current snap is 68 2026-02-20T13:11:18.522 INFO:tasks.rados.rados.0.trial114.stdout:470: seq_num 217 ranges {447119=786917,1665416=692733,2976554=514615} 2026-02-20T13:11:18.526 INFO:tasks.rados.rados.0.trial114.stdout:470: writing trial11441570-20 from 447119 to 1234036 tid 1 2026-02-20T13:11:18.531 INFO:tasks.rados.rados.0.trial114.stdout:470: writing trial11441570-20 from 1665416 to 2358149 tid 2 2026-02-20T13:11:18.536 INFO:tasks.rados.rados.0.trial114.stdout:470: writing trial11441570-20 from 2976554 to 3491169 tid 3 2026-02-20T13:11:18.536 INFO:tasks.rados.rados.0.trial114.stdout:471: snap_remove snap 61 2026-02-20T13:11:19.372 INFO:tasks.rados.rados.0.trial114.stdout:471: done (1 left) 2026-02-20T13:11:19.373 INFO:tasks.rados.rados.0.trial114.stdout:472: delete oid 36 current snap is 68 2026-02-20T13:11:19.373 INFO:tasks.rados.rados.0.trial114.stdout:470: finishing write tid 1 to trial11441570-20 2026-02-20T13:11:19.373 INFO:tasks.rados.rados.0.trial114.stdout:470: finishing write tid 2 to trial11441570-20 2026-02-20T13:11:19.373 INFO:tasks.rados.rados.0.trial114.stdout:470: finishing write tid 3 to trial11441570-20 2026-02-20T13:11:19.373 INFO:tasks.rados.rados.0.trial114.stdout:470: finishing write tid 4 to trial11441570-20 2026-02-20T13:11:19.373 INFO:tasks.rados.rados.0.trial114.stdout:470: finishing write tid 5 to trial11441570-20 2026-02-20T13:11:19.373 INFO:tasks.rados.rados.0.trial114.stdout:470: oid 20 updating version 0 to 67 2026-02-20T13:11:19.373 INFO:tasks.rados.rados.0.trial114.stdout:470: oid 20 updating version 67 to 70 2026-02-20T13:11:19.374 INFO:tasks.rados.rados.0.trial114.stdout:470: oid 20 version 70 is already newer than 70 2026-02-20T13:11:19.374 INFO:tasks.rados.rados.0.trial114.stdout:470: oid 20 version 70 is already newer than 70 2026-02-20T13:11:19.374 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 20 v 70 (ObjNum 217 snap 68 seq_num 217) dirty exists 2026-02-20T13:11:19.374 INFO:tasks.rados.rados.0.trial114.stdout:470: left oid 20 (ObjNum 217 snap 68 seq_num 217) 2026-02-20T13:11:19.414 INFO:tasks.rados.rados.0.trial114.stdout:470: done (1 left) 2026-02-20T13:11:19.414 INFO:tasks.rados.rados.0.trial114.stdout:472: done (0 left) 2026-02-20T13:11:19.414 INFO:tasks.rados.rados.0.trial114.stdout:473: delete oid 1 current snap is 68 2026-02-20T13:11:19.417 INFO:tasks.rados.rados.0.trial114.stdout:473: done (0 left) 2026-02-20T13:11:19.417 INFO:tasks.rados.rados.0.trial114.stdout:474: read oid 17 snap -1 2026-02-20T13:11:19.417 INFO:tasks.rados.rados.0.trial114.stdout:474: expect (ObjNum 197 snap 62 seq_num 197) 2026-02-20T13:11:19.417 INFO:tasks.rados.rados.0.trial114.stdout:475: read oid 43 snap -1 2026-02-20T13:11:19.417 INFO:tasks.rados.rados.0.trial114.stdout:475: expect (ObjNum 171 snap 46 seq_num 171) 2026-02-20T13:11:19.417 INFO:tasks.rados.rados.0.trial114.stdout:476: read oid 37 snap 62 2026-02-20T13:11:19.417 INFO:tasks.rados.rados.0.trial114.stdout:476: expect deleted 2026-02-20T13:11:19.417 INFO:tasks.rados.rados.0.trial114.stdout:477: read oid 38 snap -1 2026-02-20T13:11:19.417 INFO:tasks.rados.rados.0.trial114.stdout:477: expect deleted 2026-02-20T13:11:19.418 INFO:tasks.rados.rados.0.trial114.stdout:478: snap_create 2026-02-20T13:11:19.441 INFO:tasks.rados.rados.0.trial114.stdout:475: expect (ObjNum 171 snap 46 seq_num 171) 2026-02-20T13:11:19.441 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:19.534 INFO:tasks.rados.rados.0.trial114.stdout:474: expect (ObjNum 197 snap 62 seq_num 197) 2026-02-20T13:11:19.534 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:19.590 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:19.667 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:19.743 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:19.740+0000 7fb26b19c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:19.746 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:19.743+0000 7fb26b19c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:19.773 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:19.789 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:19.790 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:20.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~116s 2026-02-20T13:11:20.376 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:20.377 INFO:tasks.rados.rados.0.trial114.stdout:474: done (4 left) 2026-02-20T13:11:20.378 INFO:tasks.rados.rados.0.trial114.stdout:475: done (3 left) 2026-02-20T13:11:20.378 INFO:tasks.rados.rados.0.trial114.stdout:476: done (2 left) 2026-02-20T13:11:20.378 INFO:tasks.rados.rados.0.trial114.stdout:477: done (1 left) 2026-02-20T13:11:20.378 INFO:tasks.rados.rados.0.trial114.stdout:478: done (0 left) 2026-02-20T13:11:20.378 INFO:tasks.rados.rados.0.trial114.stdout:479: read oid 9 snap -1 2026-02-20T13:11:20.378 INFO:tasks.rados.rados.0.trial114.stdout:479: expect (ObjNum 182 snap 54 seq_num 182) 2026-02-20T13:11:20.378 INFO:tasks.rados.rados.0.trial114.stdout:480: snap_create 2026-02-20T13:11:20.401 INFO:tasks.rados.rados.0.trial114.stdout:479: expect (ObjNum 182 snap 54 seq_num 182) 2026-02-20T13:11:20.442 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:20.446 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:20.448 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:20.449 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:21.378 INFO:tasks.rados.rados.0.trial114.stdout:479: done (1 left) 2026-02-20T13:11:21.378 INFO:tasks.rados.rados.0.trial114.stdout:480: done (0 left) 2026-02-20T13:11:21.379 INFO:tasks.rados.rados.0.trial114.stdout:481: write (excl) oid 24 current snap is 70 2026-02-20T13:11:21.379 INFO:tasks.rados.rados.0.trial114.stdout:481: seq_num 220 ranges {497540=612664,1840862=440060,3058823=464784} 2026-02-20T13:11:21.382 INFO:tasks.rados.rados.0.trial114.stdout:481: writing trial11441570-24 from 497540 to 1110204 tid 1 2026-02-20T13:11:21.388 INFO:tasks.rados.rados.0.trial114.stdout:481: writing trial11441570-24 from 1840862 to 2280922 tid 2 2026-02-20T13:11:21.393 INFO:tasks.rados.rados.0.trial114.stdout:481: writing trial11441570-24 from 3058823 to 3523607 tid 3 2026-02-20T13:11:21.393 INFO:tasks.rados.rados.0.trial114.stdout:482: read oid 4 snap -1 2026-02-20T13:11:21.393 INFO:tasks.rados.rados.0.trial114.stdout:482: expect deleted 2026-02-20T13:11:21.393 INFO:tasks.rados.rados.0.trial114.stdout:483: read oid 6 snap -1 2026-02-20T13:11:21.393 INFO:tasks.rados.rados.0.trial114.stdout:483: expect (ObjNum 190 snap 57 seq_num 190) 2026-02-20T13:11:21.393 INFO:tasks.rados.rados.0.trial114.stdout:484: read oid 41 snap 63 2026-02-20T13:11:21.394 INFO:tasks.rados.rados.0.trial114.stdout:484: expect (ObjNum 67 snap 5 seq_num 67) 2026-02-20T13:11:21.394 INFO:tasks.rados.rados.0.trial114.stdout:485: delete oid 8 current snap is 70 2026-02-20T13:11:21.407 INFO:tasks.rados.rados.0.trial114.stdout:483: expect (ObjNum 190 snap 57 seq_num 190) 2026-02-20T13:11:21.407 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:21.446 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:21.516 INFO:tasks.rados.rados.0.trial114.stdout:484: expect (ObjNum 67 snap 5 seq_num 67) 2026-02-20T13:11:21.516 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:21.557 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 837100 2026-02-20T13:11:21.584 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:21.621 INFO:tasks.rados.rados.0.trial114.stdout:481: finishing write tid 1 to trial11441570-24 2026-02-20T13:11:21.621 INFO:tasks.rados.rados.0.trial114.stdout:481: finishing write tid 2 to trial11441570-24 2026-02-20T13:11:21.621 INFO:tasks.rados.rados.0.trial114.stdout:481: finishing write tid 3 to trial11441570-24 2026-02-20T13:11:21.621 INFO:tasks.rados.rados.0.trial114.stdout:481: finishing write tid 4 to trial11441570-24 2026-02-20T13:11:21.621 INFO:tasks.rados.rados.0.trial114.stdout:481: finishing write tid 5 to trial11441570-24 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:481: oid 24 updating version 0 to 198 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:481: oid 24 updating version 198 to 201 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:481: oid 24 version 201 is already newer than 201 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:481: oid 24 version 201 is already newer than 201 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 24 v 201 (ObjNum 220 snap 70 seq_num 220) dirty exists 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:481: left oid 24 (ObjNum 220 snap 70 seq_num 220) 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:481: done (4 left) 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:482: done (3 left) 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:483: done (2 left) 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:484: done (1 left) 2026-02-20T13:11:21.622 INFO:tasks.rados.rados.0.trial114.stdout:485: done (0 left) 2026-02-20T13:11:21.623 INFO:tasks.rados.rados.0.trial114.stdout:486: snap_remove snap 51 2026-02-20T13:11:21.791 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:21.870 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:21.866+0000 7f68f125a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:21.873 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:21.870+0000 7f68f125a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:21.902 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:21.917 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:21.918 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:22.379 INFO:tasks.rados.rados.0.trial114.stdout:486: done (0 left) 2026-02-20T13:11:22.379 INFO:tasks.rados.rados.0.trial114.stdout:487: snap_create 2026-02-20T13:11:23.382 INFO:tasks.rados.rados.0.trial114.stdout:487: done (0 left) 2026-02-20T13:11:23.382 INFO:tasks.rados.rados.0.trial114.stdout:488: read oid 19 snap -1 2026-02-20T13:11:23.382 INFO:tasks.rados.rados.0.trial114.stdout:488: expect (ObjNum 129 snap 27 seq_num 129) 2026-02-20T13:11:23.383 INFO:tasks.rados.rados.0.trial114.stdout:489: delete oid 3 current snap is 71 2026-02-20T13:11:23.402 INFO:tasks.rados.rados.0.trial114.stdout:488: expect (ObjNum 129 snap 27 seq_num 129) 2026-02-20T13:11:23.404 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1595961 2026-02-20T13:11:23.445 INFO:tasks.rados.rados.0.trial114.stdout:488: done (1 left) 2026-02-20T13:11:23.445 INFO:tasks.rados.rados.0.trial114.stdout:489: done (0 left) 2026-02-20T13:11:23.446 INFO:tasks.rados.rados.0.trial114.stdout:490: read oid 22 snap 66 2026-02-20T13:11:23.446 INFO:tasks.rados.rados.0.trial114.stdout:490: expect (ObjNum 191 snap 58 seq_num 191) 2026-02-20T13:11:23.446 INFO:tasks.rados.rados.0.trial114.stdout:491: read oid 12 snap -1 2026-02-20T13:11:23.446 INFO:tasks.rados.rados.0.trial114.stdout:491: expect deleted 2026-02-20T13:11:23.446 INFO:tasks.rados.rados.0.trial114.stdout:492: write (excl) oid 18 current snap is 71 2026-02-20T13:11:23.446 INFO:tasks.rados.rados.0.trial114.stdout:492: seq_num 223 ranges {547961=554764,1616308=703740,2741092=698600} 2026-02-20T13:11:23.449 INFO:tasks.rados.rados.0.trial114.stdout:492: writing trial11441570-18 from 547961 to 1102725 tid 1 2026-02-20T13:11:23.454 INFO:tasks.rados.rados.0.trial114.stdout:492: writing trial11441570-18 from 1616308 to 2320048 tid 2 2026-02-20T13:11:23.459 INFO:tasks.rados.rados.0.trial114.stdout:492: writing trial11441570-18 from 2741092 to 3439692 tid 3 2026-02-20T13:11:23.459 INFO:tasks.rados.rados.0.trial114.stdout:493: read oid 45 snap -1 2026-02-20T13:11:23.460 INFO:tasks.rados.rados.0.trial114.stdout:493: expect (ObjNum 204 snap 63 seq_num 204) 2026-02-20T13:11:23.460 INFO:tasks.rados.rados.0.trial114.stdout:494: read oid 31 snap -1 2026-02-20T13:11:23.460 INFO:tasks.rados.rados.0.trial114.stdout:494: expect (ObjNum 172 snap 46 seq_num 172) 2026-02-20T13:11:23.460 INFO:tasks.rados.rados.0.trial114.stdout:495: snap_remove snap 58 2026-02-20T13:11:23.919 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:23.996 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:23.993+0000 7f0cfb25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:23.999 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:23.996+0000 7f0cfb25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:24.025 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:24.046 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:24.047 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:24.386 INFO:tasks.rados.rados.0.trial114.stdout:495: done (5 left) 2026-02-20T13:11:24.386 INFO:tasks.rados.rados.0.trial114.stdout:496: delete oid 47 current snap is 71 2026-02-20T13:11:24.386 INFO:tasks.rados.rados.0.trial114.stdout:490: expect (ObjNum 191 snap 58 seq_num 191) 2026-02-20T13:11:24.413 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:24.439 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:24.467 INFO:tasks.rados.rados.0.trial114.stdout:490: done (5 left) 2026-02-20T13:11:24.467 INFO:tasks.rados.rados.0.trial114.stdout:491: done (4 left) 2026-02-20T13:11:24.467 INFO:tasks.rados.rados.0.trial114.stdout:496: done (3 left) 2026-02-20T13:11:24.467 INFO:tasks.rados.rados.0.trial114.stdout:497: read oid 3 snap -1 2026-02-20T13:11:24.468 INFO:tasks.rados.rados.0.trial114.stdout:497: expect deleted 2026-02-20T13:11:24.468 INFO:tasks.rados.rados.0.trial114.stdout:498: read oid 22 snap -1 2026-02-20T13:11:24.468 INFO:tasks.rados.rados.0.trial114.stdout:498: expect (ObjNum 191 snap 58 seq_num 191) 2026-02-20T13:11:24.468 INFO:tasks.rados.rados.0.trial114.stdout:499: write oid 2 current snap is 71 2026-02-20T13:11:24.468 INFO:tasks.rados.rados.0.trial114.stdout:499: seq_num 225 ranges {581575=705262,1733272=707409,3195938=437497} 2026-02-20T13:11:24.472 INFO:tasks.rados.rados.0.trial114.stdout:499: writing trial11441570-2 from 581575 to 1286837 tid 1 2026-02-20T13:11:24.476 INFO:tasks.rados.rados.0.trial114.stdout:499: writing trial11441570-2 from 1733272 to 2440681 tid 2 2026-02-20T13:11:24.481 INFO:tasks.rados.rados.0.trial114.stdout:499: writing trial11441570-2 from 3195938 to 3633435 tid 3 2026-02-20T13:11:24.481 INFO:tasks.rados.rados.0.trial114.stdout:500: snap_remove snap 64 2026-02-20T13:11:25.389 INFO:tasks.rados.rados.0.trial114.stdout:500: done (6 left) 2026-02-20T13:11:25.389 INFO:tasks.rados.rados.0.trial114.stdout:501: write (excl) oid 17 current snap is 71 2026-02-20T13:11:25.389 INFO:tasks.rados.rados.0.trial114.stdout:501: seq_num 226 ranges {598382=780511,2075401=451067,3107008=648769} 2026-02-20T13:11:25.394 INFO:tasks.rados.rados.0.trial114.stdout:501: writing trial11441570-17 from 598382 to 1378893 tid 1 2026-02-20T13:11:25.398 INFO:tasks.rados.rados.0.trial114.stdout:501: writing trial11441570-17 from 2075401 to 2526468 tid 2 2026-02-20T13:11:25.404 INFO:tasks.rados.rados.0.trial114.stdout:501: writing trial11441570-17 from 3107008 to 3755777 tid 3 2026-02-20T13:11:25.404 INFO:tasks.rados.rados.0.trial114.stdout:502: write oid 9 current snap is 71 2026-02-20T13:11:25.404 INFO:tasks.rados.rados.0.trial114.stdout:502: seq_num 227 ranges {615189=455760,1733883=711078,3134431=460041} 2026-02-20T13:11:25.408 INFO:tasks.rados.rados.0.trial114.stdout:502: writing trial11441570-9 from 615189 to 1070949 tid 1 2026-02-20T13:11:25.413 INFO:tasks.rados.rados.0.trial114.stdout:502: writing trial11441570-9 from 1733883 to 2444961 tid 2 2026-02-20T13:11:25.417 INFO:tasks.rados.rados.0.trial114.stdout:502: writing trial11441570-9 from 3134431 to 3594472 tid 3 2026-02-20T13:11:25.417 INFO:tasks.rados.rados.0.trial114.stdout:503: read oid 14 snap 67 2026-02-20T13:11:25.417 INFO:tasks.rados.rados.0.trial114.stdout:503: expect (ObjNum 162 snap 40 seq_num 162) 2026-02-20T13:11:25.417 INFO:tasks.rados.rados.0.trial114.stdout:504: snap_remove snap 63 2026-02-20T13:11:25.450 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:25.520 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:25.522 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:25.523 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:25.872 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~121s 2026-02-20T13:11:26.048 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:26.125 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:26.122+0000 7f37a5c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:26.128 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:26.126+0000 7f37a5c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:26.155 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:26.171 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:26.172 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:26.394 INFO:tasks.rados.rados.0.trial114.stdout:504: done (9 left) 2026-02-20T13:11:26.394 INFO:tasks.rados.rados.0.trial114.stdout:505: snap_create 2026-02-20T13:11:26.394 INFO:tasks.rados.rados.0.trial114.stdout:493: expect (ObjNum 204 snap 63 seq_num 204) 2026-02-20T13:11:26.394 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:26.424 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:26.482 INFO:tasks.rados.rados.0.trial114.stdout:492: finishing write tid 1 to trial11441570-18 2026-02-20T13:11:26.482 INFO:tasks.rados.rados.0.trial114.stdout:494: expect (ObjNum 172 snap 46 seq_num 172) 2026-02-20T13:11:26.482 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:26.581 INFO:tasks.rados.rados.0.trial114.stdout:492: finishing write tid 2 to trial11441570-18 2026-02-20T13:11:26.581 INFO:tasks.rados.rados.0.trial114.stdout:492: finishing write tid 3 to trial11441570-18 2026-02-20T13:11:26.581 INFO:tasks.rados.rados.0.trial114.stdout:492: finishing write tid 4 to trial11441570-18 2026-02-20T13:11:26.581 INFO:tasks.rados.rados.0.trial114.stdout:492: finishing write tid 5 to trial11441570-18 2026-02-20T13:11:26.581 INFO:tasks.rados.rados.0.trial114.stdout:492: oid 18 updating version 0 to 62 2026-02-20T13:11:26.581 INFO:tasks.rados.rados.0.trial114.stdout:492: oid 18 version 62 is already newer than 59 2026-02-20T13:11:26.581 INFO:tasks.rados.rados.0.trial114.stdout:492: oid 18 version 62 is already newer than 62 2026-02-20T13:11:26.581 INFO:tasks.rados.rados.0.trial114.stdout:492: oid 18 version 62 is already newer than 62 2026-02-20T13:11:26.581 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 18 v 62 (ObjNum 223 snap 71 seq_num 223) dirty exists 2026-02-20T13:11:26.582 INFO:tasks.rados.rados.0.trial114.stdout:492: left oid 18 (ObjNum 223 snap 71 seq_num 223) 2026-02-20T13:11:26.582 INFO:tasks.rados.rados.0.trial114.stdout:498: expect (ObjNum 191 snap 58 seq_num 191) 2026-02-20T13:11:26.592 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 3126312 2026-02-20T13:11:26.643 INFO:tasks.rados.rados.0.trial114.stdout:499: finishing write tid 1 to trial11441570-2 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:499: finishing write tid 2 to trial11441570-2 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:499: finishing write tid 3 to trial11441570-2 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:499: finishing write tid 4 to trial11441570-2 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:499: finishing write tid 5 to trial11441570-2 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:499: oid 2 updating version 0 to 25 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:499: oid 2 version 25 is already newer than 25 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:499: oid 2 version 25 is already newer than 25 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:499: oid 2 version 25 is already newer than 25 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 2 v 25 (ObjNum 225 snap 71 seq_num 225) dirty exists 2026-02-20T13:11:26.644 INFO:tasks.rados.rados.0.trial114.stdout:499: left oid 2 (ObjNum 225 snap 71 seq_num 225) 2026-02-20T13:11:26.645 INFO:tasks.rados.rados.0.trial114.stdout:503: expect (ObjNum 162 snap 40 seq_num 162) 2026-02-20T13:11:26.645 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:26.677 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:26.742 INFO:tasks.rados.rados.0.trial114.stdout:501: finishing write tid 1 to trial11441570-17 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: finishing write tid 1 to trial11441570-9 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: finishing write tid 2 to trial11441570-9 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: finishing write tid 3 to trial11441570-9 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:501: finishing write tid 2 to trial11441570-17 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: finishing write tid 4 to trial11441570-9 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: finishing write tid 5 to trial11441570-9 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: oid 9 updating version 0 to 102 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: oid 9 version 102 is already newer than 102 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: oid 9 version 102 is already newer than 102 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: oid 9 version 102 is already newer than 102 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 9 v 102 (ObjNum 227 snap 71 seq_num 227) dirty exists 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:502: left oid 9 (ObjNum 227 snap 71 seq_num 227) 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:501: finishing write tid 3 to trial11441570-17 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:501: finishing write tid 4 to trial11441570-17 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:501: finishing write tid 5 to trial11441570-17 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:501: oid 17 updating version 0 to 77 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:501: oid 17 updating version 77 to 80 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:501: oid 17 version 80 is already newer than 80 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:501: oid 17 version 80 is already newer than 80 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 17 v 80 (ObjNum 226 snap 71 seq_num 226) dirty exists 2026-02-20T13:11:26.743 INFO:tasks.rados.rados.0.trial114.stdout:501: left oid 17 (ObjNum 226 snap 71 seq_num 226) 2026-02-20T13:11:27.397 INFO:tasks.rados.rados.0.trial114.stdout:492: done (9 left) 2026-02-20T13:11:27.397 INFO:tasks.rados.rados.0.trial114.stdout:493: done (8 left) 2026-02-20T13:11:27.397 INFO:tasks.rados.rados.0.trial114.stdout:494: done (7 left) 2026-02-20T13:11:27.397 INFO:tasks.rados.rados.0.trial114.stdout:497: done (6 left) 2026-02-20T13:11:27.397 INFO:tasks.rados.rados.0.trial114.stdout:498: done (5 left) 2026-02-20T13:11:27.397 INFO:tasks.rados.rados.0.trial114.stdout:499: done (4 left) 2026-02-20T13:11:27.397 INFO:tasks.rados.rados.0.trial114.stdout:501: done (3 left) 2026-02-20T13:11:27.398 INFO:tasks.rados.rados.0.trial114.stdout:502: done (2 left) 2026-02-20T13:11:27.398 INFO:tasks.rados.rados.0.trial114.stdout:503: done (1 left) 2026-02-20T13:11:27.398 INFO:tasks.rados.rados.0.trial114.stdout:505: done (0 left) 2026-02-20T13:11:27.398 INFO:tasks.rados.rados.0.trial114.stdout:506: delete oid 2 current snap is 72 2026-02-20T13:11:27.441 INFO:tasks.rados.rados.0.trial114.stdout:506: done (0 left) 2026-02-20T13:11:27.441 INFO:tasks.rados.rados.0.trial114.stdout:507: read oid 14 snap -1 2026-02-20T13:11:27.441 INFO:tasks.rados.rados.0.trial114.stdout:507: expect (ObjNum 162 snap 40 seq_num 162) 2026-02-20T13:11:27.441 INFO:tasks.rados.rados.0.trial114.stdout:508: write oid 31 current snap is 72 2026-02-20T13:11:27.441 INFO:tasks.rados.rados.0.trial114.stdout:508: seq_num 229 ranges {648803=722611,1967200=714747,3421983=426820} 2026-02-20T13:11:27.446 INFO:tasks.rados.rados.0.trial114.stdout:508: writing trial11441570-31 from 648803 to 1371414 tid 1 2026-02-20T13:11:27.451 INFO:tasks.rados.rados.0.trial114.stdout:508: writing trial11441570-31 from 1967200 to 2681947 tid 2 2026-02-20T13:11:27.455 INFO:tasks.rados.rados.0.trial114.stdout:508: writing trial11441570-31 from 3421983 to 3848803 tid 3 2026-02-20T13:11:27.455 INFO:tasks.rados.rados.0.trial114.stdout:509: snap_create 2026-02-20T13:11:27.469 INFO:tasks.rados.rados.0.trial114.stdout:507: expect (ObjNum 162 snap 40 seq_num 162) 2026-02-20T13:11:27.501 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:27.533 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:27.566 INFO:tasks.rados.rados.0.trial114.stdout:508: finishing write tid 1 to trial11441570-31 2026-02-20T13:11:27.566 INFO:tasks.rados.rados.0.trial114.stdout:508: finishing write tid 2 to trial11441570-31 2026-02-20T13:11:27.566 INFO:tasks.rados.rados.0.trial114.stdout:508: finishing write tid 3 to trial11441570-31 2026-02-20T13:11:27.566 INFO:tasks.rados.rados.0.trial114.stdout:508: finishing write tid 4 to trial11441570-31 2026-02-20T13:11:27.566 INFO:tasks.rados.rados.0.trial114.stdout:508: finishing write tid 5 to trial11441570-31 2026-02-20T13:11:27.566 INFO:tasks.rados.rados.0.trial114.stdout:508: oid 31 updating version 0 to 97 2026-02-20T13:11:27.566 INFO:tasks.rados.rados.0.trial114.stdout:508: oid 31 version 97 is already newer than 97 2026-02-20T13:11:27.566 INFO:tasks.rados.rados.0.trial114.stdout:508: oid 31 version 97 is already newer than 97 2026-02-20T13:11:27.567 INFO:tasks.rados.rados.0.trial114.stdout:508: oid 31 version 97 is already newer than 97 2026-02-20T13:11:27.567 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 31 v 97 (ObjNum 229 snap 72 seq_num 229) dirty exists 2026-02-20T13:11:27.567 INFO:tasks.rados.rados.0.trial114.stdout:508: left oid 31 (ObjNum 229 snap 72 seq_num 229) 2026-02-20T13:11:28.173 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:28.251 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:28.247+0000 7fdfa0bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:28.254 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:28.251+0000 7fdfa0bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:28.281 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:28.298 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:28.298 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:28.402 INFO:tasks.rados.rados.0.trial114.stdout:507: done (2 left) 2026-02-20T13:11:28.402 INFO:tasks.rados.rados.0.trial114.stdout:508: done (1 left) 2026-02-20T13:11:28.402 INFO:tasks.rados.rados.0.trial114.stdout:509: done (0 left) 2026-02-20T13:11:28.402 INFO:tasks.rados.rados.0.trial114.stdout:510: read oid 15 snap 72 2026-02-20T13:11:28.402 INFO:tasks.rados.rados.0.trial114.stdout:510: expect deleted 2026-02-20T13:11:28.402 INFO:tasks.rados.rados.0.trial114.stdout:511: read oid 43 snap 68 2026-02-20T13:11:28.402 INFO:tasks.rados.rados.0.trial114.stdout:511: expect (ObjNum 171 snap 46 seq_num 171) 2026-02-20T13:11:28.402 INFO:tasks.rados.rados.0.trial114.stdout:512: write oid 16 current snap is 73 2026-02-20T13:11:28.402 INFO:tasks.rados.rados.0.trial114.stdout:512: seq_num 230 ranges {665610=797860,1909329=458405,2816700=410210} 2026-02-20T13:11:28.407 INFO:tasks.rados.rados.0.trial114.stdout:512: writing trial11441570-16 from 665610 to 1463470 tid 1 2026-02-20T13:11:28.411 INFO:tasks.rados.rados.0.trial114.stdout:512: writing trial11441570-16 from 1909329 to 2367734 tid 2 2026-02-20T13:11:28.415 INFO:tasks.rados.rados.0.trial114.stdout:512: writing trial11441570-16 from 2816700 to 3226910 tid 3 2026-02-20T13:11:28.415 INFO:tasks.rados.rados.0.trial114.stdout:513: delete oid 2 current snap is 73 2026-02-20T13:11:28.423 INFO:tasks.rados.rados.0.trial114.stdout:510: done (3 left) 2026-02-20T13:11:28.423 INFO:tasks.rados.rados.0.trial114.stdout:513: done (2 left) 2026-02-20T13:11:28.423 INFO:tasks.rados.rados.0.trial114.stdout:514: snap_remove snap 69 2026-02-20T13:11:29.375 INFO:tasks.rados.rados.0.trial114.stdout:514: done (2 left) 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:515: read oid 7 snap -1 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:515: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:516: snap_create 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:512: finishing write tid 1 to trial11441570-16 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:512: finishing write tid 2 to trial11441570-16 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:512: finishing write tid 3 to trial11441570-16 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:512: finishing write tid 4 to trial11441570-16 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:512: finishing write tid 5 to trial11441570-16 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:512: oid 16 updating version 0 to 42 2026-02-20T13:11:29.376 INFO:tasks.rados.rados.0.trial114.stdout:512: oid 16 version 42 is already newer than 42 2026-02-20T13:11:29.377 INFO:tasks.rados.rados.0.trial114.stdout:512: oid 16 version 42 is already newer than 42 2026-02-20T13:11:29.377 INFO:tasks.rados.rados.0.trial114.stdout:512: oid 16 version 42 is already newer than 42 2026-02-20T13:11:29.377 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 16 v 42 (ObjNum 230 snap 73 seq_num 230) dirty exists 2026-02-20T13:11:29.377 INFO:tasks.rados.rados.0.trial114.stdout:512: left oid 16 (ObjNum 230 snap 73 seq_num 230) 2026-02-20T13:11:29.377 INFO:tasks.rados.rados.0.trial114.stdout:511: expect (ObjNum 171 snap 46 seq_num 171) 2026-02-20T13:11:29.410 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1425717 2026-02-20T13:11:29.449 INFO:tasks.rados.rados.0.trial114.stdout:515: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:29.449 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:30.299 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:30.375 INFO:tasks.rados.rados.0.trial114.stdout:511: done (3 left) 2026-02-20T13:11:30.375 INFO:tasks.rados.rados.0.trial114.stdout:512: done (2 left) 2026-02-20T13:11:30.375 INFO:tasks.rados.rados.0.trial114.stdout:515: done (1 left) 2026-02-20T13:11:30.375 INFO:tasks.rados.rados.0.trial114.stdout:516: done (0 left) 2026-02-20T13:11:30.375 INFO:tasks.rados.rados.0.trial114.stdout:517: write oid 12 current snap is 74 2026-02-20T13:11:30.375 INFO:tasks.rados.rados.0.trial114.stdout:517: seq_num 232 ranges {699224=548358,2026293=462074,3271546=432754} 2026-02-20T13:11:30.376 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:30.372+0000 7f46666cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:30.379 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:30.375+0000 7f46666cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:30.380 INFO:tasks.rados.rados.0.trial114.stdout:517: writing trial11441570-12 from 699224 to 1247582 tid 1 2026-02-20T13:11:30.384 INFO:tasks.rados.rados.0.trial114.stdout:517: writing trial11441570-12 from 2026293 to 2488367 tid 2 2026-02-20T13:11:30.389 INFO:tasks.rados.rados.0.trial114.stdout:517: writing trial11441570-12 from 3271546 to 3704300 tid 3 2026-02-20T13:11:30.389 INFO:tasks.rados.rados.0.trial114.stdout:518: snap_remove snap 73 2026-02-20T13:11:30.428 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:30.443 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:30.444 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:30.524 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:30.593 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:30.595 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:30.595 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:31.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~127s 2026-02-20T13:11:31.379 INFO:tasks.rados.rados.0.trial114.stdout:518: done (1 left) 2026-02-20T13:11:31.379 INFO:tasks.rados.rados.0.trial114.stdout:519: delete oid 31 current snap is 74 2026-02-20T13:11:31.379 INFO:tasks.rados.rados.0.trial114.stdout:517: finishing write tid 1 to trial11441570-12 2026-02-20T13:11:31.379 INFO:tasks.rados.rados.0.trial114.stdout:517: finishing write tid 2 to trial11441570-12 2026-02-20T13:11:31.379 INFO:tasks.rados.rados.0.trial114.stdout:517: finishing write tid 3 to trial11441570-12 2026-02-20T13:11:31.380 INFO:tasks.rados.rados.0.trial114.stdout:517: finishing write tid 4 to trial11441570-12 2026-02-20T13:11:31.380 INFO:tasks.rados.rados.0.trial114.stdout:517: finishing write tid 5 to trial11441570-12 2026-02-20T13:11:31.380 INFO:tasks.rados.rados.0.trial114.stdout:517: oid 12 updating version 0 to 106 2026-02-20T13:11:31.380 INFO:tasks.rados.rados.0.trial114.stdout:517: oid 12 version 106 is already newer than 106 2026-02-20T13:11:31.380 INFO:tasks.rados.rados.0.trial114.stdout:517: oid 12 version 106 is already newer than 106 2026-02-20T13:11:31.380 INFO:tasks.rados.rados.0.trial114.stdout:517: oid 12 version 106 is already newer than 106 2026-02-20T13:11:31.380 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 12 v 106 (ObjNum 232 snap 74 seq_num 232) dirty exists 2026-02-20T13:11:31.380 INFO:tasks.rados.rados.0.trial114.stdout:517: left oid 12 (ObjNum 232 snap 74 seq_num 232) 2026-02-20T13:11:31.420 INFO:tasks.rados.rados.0.trial114.stdout:517: done (1 left) 2026-02-20T13:11:31.420 INFO:tasks.rados.rados.0.trial114.stdout:519: done (0 left) 2026-02-20T13:11:31.420 INFO:tasks.rados.rados.0.trial114.stdout:520: write (excl) oid 50 current snap is 74 2026-02-20T13:11:31.420 INFO:tasks.rados.rados.0.trial114.stdout:520: seq_num 234 ranges {732838=698856,2026904=465743,3210039=571651} 2026-02-20T13:11:31.425 INFO:tasks.rados.rados.0.trial114.stdout:520: writing trial11441570-50 from 732838 to 1431694 tid 1 2026-02-20T13:11:31.429 INFO:tasks.rados.rados.0.trial114.stdout:520: writing trial11441570-50 from 2026904 to 2492647 tid 2 2026-02-20T13:11:31.434 INFO:tasks.rados.rados.0.trial114.stdout:520: writing trial11441570-50 from 3210039 to 3781690 tid 3 2026-02-20T13:11:31.434 INFO:tasks.rados.rados.0.trial114.stdout:521: snap_create 2026-02-20T13:11:31.440 INFO:tasks.rados.rados.0.trial114.stdout:520: finishing write tid 1 to trial11441570-50 2026-02-20T13:11:31.454 INFO:tasks.rados.rados.0.trial114.stdout:520: finishing write tid 2 to trial11441570-50 2026-02-20T13:11:31.462 INFO:tasks.rados.rados.0.trial114.stdout:520: finishing write tid 3 to trial11441570-50 2026-02-20T13:11:31.466 INFO:tasks.rados.rados.0.trial114.stdout:520: finishing write tid 4 to trial11441570-50 2026-02-20T13:11:31.468 INFO:tasks.rados.rados.0.trial114.stdout:520: finishing write tid 5 to trial11441570-50 2026-02-20T13:11:31.468 INFO:tasks.rados.rados.0.trial114.stdout:520: oid 50 updating version 0 to 110 2026-02-20T13:11:31.469 INFO:tasks.rados.rados.0.trial114.stdout:520: oid 50 version 110 is already newer than 107 2026-02-20T13:11:31.469 INFO:tasks.rados.rados.0.trial114.stdout:520: oid 50 version 110 is already newer than 110 2026-02-20T13:11:31.469 INFO:tasks.rados.rados.0.trial114.stdout:520: oid 50 version 110 is already newer than 110 2026-02-20T13:11:31.469 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 50 v 110 (ObjNum 234 snap 74 seq_num 234) dirty exists 2026-02-20T13:11:31.469 INFO:tasks.rados.rados.0.trial114.stdout:520: left oid 50 (ObjNum 234 snap 74 seq_num 234) 2026-02-20T13:11:32.383 INFO:tasks.rados.rados.0.trial114.stdout:520: done (1 left) 2026-02-20T13:11:32.384 INFO:tasks.rados.rados.0.trial114.stdout:521: done (0 left) 2026-02-20T13:11:32.384 INFO:tasks.rados.rados.0.trial114.stdout:522: read oid 17 snap -1 2026-02-20T13:11:32.384 INFO:tasks.rados.rados.0.trial114.stdout:522: expect (ObjNum 226 snap 71 seq_num 226) 2026-02-20T13:11:32.384 INFO:tasks.rados.rados.0.trial114.stdout:523: snap_create 2026-02-20T13:11:32.422 INFO:tasks.rados.rados.0.trial114.stdout:522: expect (ObjNum 226 snap 71 seq_num 226) 2026-02-20T13:11:32.422 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:32.445 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:32.513 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2048706 2026-02-20T13:11:32.521 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:32.516+0000 7fad43c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:32.523 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:32.520+0000 7fad43c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:32.551 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:32.568 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:32.569 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:33.389 INFO:tasks.rados.rados.0.trial114.stdout:522: done (1 left) 2026-02-20T13:11:33.389 INFO:tasks.rados.rados.0.trial114.stdout:523: done (0 left) 2026-02-20T13:11:33.389 INFO:tasks.rados.rados.0.trial114.stdout:524: write oid 36 current snap is 76 2026-02-20T13:11:33.389 INFO:tasks.rados.rados.0.trial114.stdout:524: seq_num 235 ranges {749645=774105,2085386=609401,3237462=712183} 2026-02-20T13:11:33.395 INFO:tasks.rados.rados.0.trial114.stdout:524: writing trial11441570-36 from 749645 to 1523750 tid 1 2026-02-20T13:11:33.399 INFO:tasks.rados.rados.0.trial114.stdout:524: writing trial11441570-36 from 2085386 to 2694787 tid 2 2026-02-20T13:11:33.405 INFO:tasks.rados.rados.0.trial114.stdout:524: writing trial11441570-36 from 3237462 to 3949645 tid 3 2026-02-20T13:11:33.405 INFO:tasks.rados.rados.0.trial114.stdout:525: read oid 31 snap -1 2026-02-20T13:11:33.405 INFO:tasks.rados.rados.0.trial114.stdout:525: expect deleted 2026-02-20T13:11:33.405 INFO:tasks.rados.rados.0.trial114.stdout:526: write (excl) oid 1 current snap is 76 2026-02-20T13:11:33.405 INFO:tasks.rados.rados.0.trial114.stdout:526: seq_num 236 ranges {766452=565707,1860221=469412,2981238=594195} 2026-02-20T13:11:33.410 INFO:tasks.rados.rados.0.trial114.stdout:526: writing trial11441570-1 from 766452 to 1332159 tid 1 2026-02-20T13:11:33.414 INFO:tasks.rados.rados.0.trial114.stdout:526: writing trial11441570-1 from 1860221 to 2329633 tid 2 2026-02-20T13:11:33.419 INFO:tasks.rados.rados.0.trial114.stdout:526: writing trial11441570-1 from 2981238 to 3575433 tid 3 2026-02-20T13:11:33.419 INFO:tasks.rados.rados.0.trial114.stdout:527: delete oid 14 current snap is 76 2026-02-20T13:11:33.424 INFO:tasks.rados.rados.0.trial114.stdout:524: finishing write tid 1 to trial11441570-36 2026-02-20T13:11:33.440 INFO:tasks.rados.rados.0.trial114.stdout:524: finishing write tid 2 to trial11441570-36 2026-02-20T13:11:33.441 INFO:tasks.rados.rados.0.trial114.stdout:524: finishing write tid 3 to trial11441570-36 2026-02-20T13:11:33.447 INFO:tasks.rados.rados.0.trial114.stdout:524: finishing write tid 4 to trial11441570-36 2026-02-20T13:11:33.448 INFO:tasks.rados.rados.0.trial114.stdout:524: finishing write tid 5 to trial11441570-36 2026-02-20T13:11:33.449 INFO:tasks.rados.rados.0.trial114.stdout:524: oid 36 updating version 0 to 184 2026-02-20T13:11:33.449 INFO:tasks.rados.rados.0.trial114.stdout:524: oid 36 version 184 is already newer than 184 2026-02-20T13:11:33.449 INFO:tasks.rados.rados.0.trial114.stdout:524: oid 36 version 184 is already newer than 184 2026-02-20T13:11:33.449 INFO:tasks.rados.rados.0.trial114.stdout:524: oid 36 version 184 is already newer than 184 2026-02-20T13:11:33.449 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 36 v 184 (ObjNum 235 snap 76 seq_num 235) dirty exists 2026-02-20T13:11:33.449 INFO:tasks.rados.rados.0.trial114.stdout:524: left oid 36 (ObjNum 235 snap 76 seq_num 235) 2026-02-20T13:11:33.453 INFO:tasks.rados.rados.0.trial114.stdout:526: finishing write tid 1 to trial11441570-1 2026-02-20T13:11:33.461 INFO:tasks.rados.rados.0.trial114.stdout:524: done (3 left) 2026-02-20T13:11:33.461 INFO:tasks.rados.rados.0.trial114.stdout:525: done (2 left) 2026-02-20T13:11:33.461 INFO:tasks.rados.rados.0.trial114.stdout:527: done (1 left) 2026-02-20T13:11:33.461 INFO:tasks.rados.rados.0.trial114.stdout:528: write oid 44 current snap is 76 2026-02-20T13:11:33.461 INFO:tasks.rados.rados.0.trial114.stdout:528: seq_num 238 ranges {400066=716205,1860832=139234} 2026-02-20T13:11:33.465 INFO:tasks.rados.rados.0.trial114.stdout:528: writing trial11441570-44 from 400066 to 1116271 tid 1 2026-02-20T13:11:33.468 INFO:tasks.rados.rados.0.trial114.stdout:528: writing trial11441570-44 from 1860832 to 2000066 tid 2 2026-02-20T13:11:33.468 INFO:tasks.rados.rados.0.trial114.stdout:529: read oid 28 snap 66 2026-02-20T13:11:33.469 INFO:tasks.rados.rados.0.trial114.stdout:529: expect (ObjNum 152 snap 35 seq_num 152) 2026-02-20T13:11:33.469 INFO:tasks.rados.rados.0.trial114.stdout:530: delete oid 14 current snap is 76 2026-02-20T13:11:33.469 INFO:tasks.rados.rados.0.trial114.stdout:526: finishing write tid 2 to trial11441570-1 2026-02-20T13:11:33.471 INFO:tasks.rados.rados.0.trial114.stdout:530: done (3 left) 2026-02-20T13:11:33.471 INFO:tasks.rados.rados.0.trial114.stdout:531: snap_create 2026-02-20T13:11:33.472 INFO:tasks.rados.rados.0.trial114.stdout:526: finishing write tid 3 to trial11441570-1 2026-02-20T13:11:33.477 INFO:tasks.rados.rados.0.trial114.stdout:526: finishing write tid 4 to trial11441570-1 2026-02-20T13:11:33.479 INFO:tasks.rados.rados.0.trial114.stdout:526: finishing write tid 5 to trial11441570-1 2026-02-20T13:11:33.479 INFO:tasks.rados.rados.0.trial114.stdout:526: oid 1 updating version 0 to 90 2026-02-20T13:11:33.480 INFO:tasks.rados.rados.0.trial114.stdout:526: oid 1 version 90 is already newer than 90 2026-02-20T13:11:33.480 INFO:tasks.rados.rados.0.trial114.stdout:526: oid 1 version 90 is already newer than 87 2026-02-20T13:11:33.480 INFO:tasks.rados.rados.0.trial114.stdout:526: oid 1 version 90 is already newer than 90 2026-02-20T13:11:33.480 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 1 v 90 (ObjNum 236 snap 76 seq_num 236) dirty exists 2026-02-20T13:11:33.480 INFO:tasks.rados.rados.0.trial114.stdout:526: left oid 1 (ObjNum 236 snap 76 seq_num 236) 2026-02-20T13:11:33.510 INFO:tasks.rados.rados.0.trial114.stdout:528: finishing write tid 1 to trial11441570-44 2026-02-20T13:11:33.512 INFO:tasks.rados.rados.0.trial114.stdout:529: expect (ObjNum 152 snap 35 seq_num 152) 2026-02-20T13:11:33.512 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 211045 2026-02-20T13:11:33.546 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1068392 2026-02-20T13:11:33.584 INFO:tasks.rados.rados.0.trial114.stdout:528: finishing write tid 2 to trial11441570-44 2026-02-20T13:11:33.584 INFO:tasks.rados.rados.0.trial114.stdout:528: finishing write tid 3 to trial11441570-44 2026-02-20T13:11:33.585 INFO:tasks.rados.rados.0.trial114.stdout:528: finishing write tid 4 to trial11441570-44 2026-02-20T13:11:33.585 INFO:tasks.rados.rados.0.trial114.stdout:528: oid 44 updating version 0 to 188 2026-02-20T13:11:33.585 INFO:tasks.rados.rados.0.trial114.stdout:528: oid 44 version 188 is already newer than 188 2026-02-20T13:11:33.585 INFO:tasks.rados.rados.0.trial114.stdout:528: oid 44 version 188 is already newer than 188 2026-02-20T13:11:33.585 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 188 (ObjNum 238 snap 76 seq_num 238) dirty exists 2026-02-20T13:11:33.585 INFO:tasks.rados.rados.0.trial114.stdout:528: left oid 44 (ObjNum 238 snap 76 seq_num 238) 2026-02-20T13:11:34.394 INFO:tasks.rados.rados.0.trial114.stdout:526: done (3 left) 2026-02-20T13:11:34.394 INFO:tasks.rados.rados.0.trial114.stdout:528: done (2 left) 2026-02-20T13:11:34.394 INFO:tasks.rados.rados.0.trial114.stdout:529: done (1 left) 2026-02-20T13:11:34.394 INFO:tasks.rados.rados.0.trial114.stdout:531: done (0 left) 2026-02-20T13:11:34.394 INFO:tasks.rados.rados.0.trial114.stdout:532: snap_remove snap 48 2026-02-20T13:11:34.570 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:34.648 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:34.644+0000 7f01babe4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:34.651 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:34.647+0000 7f01babe4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:34.678 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:34.694 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:34.694 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:35.395 INFO:tasks.rados.rados.0.trial114.stdout:532: done (0 left) 2026-02-20T13:11:35.395 INFO:tasks.rados.rados.0.trial114.stdout:533: snap_remove snap 75 2026-02-20T13:11:35.597 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:35.669 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:35.672 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:35.672 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:36.399 INFO:tasks.rados.rados.0.trial114.stdout:533: done (0 left) 2026-02-20T13:11:36.400 INFO:tasks.rados.rados.0.trial114.stdout:534: write oid 26 current snap is 77 2026-02-20T13:11:36.400 INFO:tasks.rados.rados.0.trial114.stdout:534: seq_num 240 ranges {433680=466703,1577796=455884} 2026-02-20T13:11:36.403 INFO:tasks.rados.rados.0.trial114.stdout:534: writing trial11441570-26 from 433680 to 900383 tid 1 2026-02-20T13:11:36.408 INFO:tasks.rados.rados.0.trial114.stdout:534: writing trial11441570-26 from 1577796 to 2033680 tid 2 2026-02-20T13:11:36.408 INFO:tasks.rados.rados.0.trial114.stdout:535: read oid 29 snap -1 2026-02-20T13:11:36.408 INFO:tasks.rados.rados.0.trial114.stdout:535: expect (ObjNum 189 snap 57 seq_num 189) 2026-02-20T13:11:36.408 INFO:tasks.rados.rados.0.trial114.stdout:536: write (excl) oid 41 current snap is 77 2026-02-20T13:11:36.408 INFO:tasks.rados.rados.0.trial114.stdout:536: seq_num 241 ranges {450487=541952,1636278=414209} 2026-02-20T13:11:36.412 INFO:tasks.rados.rados.0.trial114.stdout:536: writing trial11441570-41 from 450487 to 992439 tid 1 2026-02-20T13:11:36.416 INFO:tasks.rados.rados.0.trial114.stdout:536: writing trial11441570-41 from 1636278 to 2050487 tid 2 2026-02-20T13:11:36.416 INFO:tasks.rados.rados.0.trial114.stdout:537: write oid 42 current snap is 77 2026-02-20T13:11:36.416 INFO:tasks.rados.rados.0.trial114.stdout:537: seq_num 242 ranges {467294=617201,1578407=488887} 2026-02-20T13:11:36.420 INFO:tasks.rados.rados.0.trial114.stdout:537: writing trial11441570-42 from 467294 to 1084495 tid 1 2026-02-20T13:11:36.424 INFO:tasks.rados.rados.0.trial114.stdout:537: writing trial11441570-42 from 1578407 to 2067294 tid 2 2026-02-20T13:11:36.424 INFO:tasks.rados.rados.0.trial114.stdout:538: write (excl) oid 46 current snap is 77 2026-02-20T13:11:36.424 INFO:tasks.rados.rados.0.trial114.stdout:538: seq_num 243 ranges {484101=692450,1636889=447212} 2026-02-20T13:11:36.428 INFO:tasks.rados.rados.0.trial114.stdout:538: writing trial11441570-46 from 484101 to 1176551 tid 1 2026-02-20T13:11:36.432 INFO:tasks.rados.rados.0.trial114.stdout:538: writing trial11441570-46 from 1636889 to 2084101 tid 2 2026-02-20T13:11:36.432 INFO:tasks.rados.rados.0.trial114.stdout:539: write (excl) oid 17 current snap is 77 2026-02-20T13:11:36.432 INFO:tasks.rados.rados.0.trial114.stdout:539: seq_num 244 ranges {500908=484052,1411724=689184} 2026-02-20T13:11:36.435 INFO:tasks.rados.rados.0.trial114.stdout:539: writing trial11441570-17 from 500908 to 984960 tid 1 2026-02-20T13:11:36.440 INFO:tasks.rados.rados.0.trial114.stdout:539: writing trial11441570-17 from 1411724 to 2100908 tid 2 2026-02-20T13:11:36.440 INFO:tasks.rados.rados.0.trial114.stdout:540: write (excl) oid 10 current snap is 77 2026-02-20T13:11:36.440 INFO:tasks.rados.rados.0.trial114.stdout:540: seq_num 245 ranges {517715=559301,1870206=247509} 2026-02-20T13:11:36.444 INFO:tasks.rados.rados.0.trial114.stdout:540: writing trial11441570-10 from 517715 to 1077016 tid 1 2026-02-20T13:11:36.448 INFO:tasks.rados.rados.0.trial114.stdout:540: writing trial11441570-10 from 1870206 to 2117715 tid 2 2026-02-20T13:11:36.448 INFO:tasks.rados.rados.0.trial114.stdout:541: write (excl) oid 9 current snap is 77 2026-02-20T13:11:36.448 INFO:tasks.rados.rados.0.trial114.stdout:541: seq_num 246 ranges {534522=634550,1812335=322187} 2026-02-20T13:11:36.452 INFO:tasks.rados.rados.0.trial114.stdout:541: writing trial11441570-9 from 534522 to 1169072 tid 1 2026-02-20T13:11:36.456 INFO:tasks.rados.rados.0.trial114.stdout:541: writing trial11441570-9 from 1812335 to 2134522 tid 2 2026-02-20T13:11:36.456 INFO:tasks.rados.rados.0.trial114.stdout:542: write (excl) oid 43 current snap is 77 2026-02-20T13:11:36.456 INFO:tasks.rados.rados.0.trial114.stdout:542: seq_num 247 ranges {551329=709799,1870817=280512} 2026-02-20T13:11:36.461 INFO:tasks.rados.rados.0.trial114.stdout:542: writing trial11441570-43 from 551329 to 1261128 tid 1 2026-02-20T13:11:36.464 INFO:tasks.rados.rados.0.trial114.stdout:542: writing trial11441570-43 from 1870817 to 2151329 tid 2 2026-02-20T13:11:36.465 INFO:tasks.rados.rados.0.trial114.stdout:543: read oid 15 snap 74 2026-02-20T13:11:36.465 INFO:tasks.rados.rados.0.trial114.stdout:543: expect deleted 2026-02-20T13:11:36.465 INFO:tasks.rados.rados.0.trial114.stdout:544: write oid 18 current snap is 77 2026-02-20T13:11:36.465 INFO:tasks.rados.rados.0.trial114.stdout:535: expect (ObjNum 189 snap 57 seq_num 189) 2026-02-20T13:11:36.494 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 851829 2026-02-20T13:11:36.545 INFO:tasks.rados.rados.0.trial114.stdout:534: finishing write tid 1 to trial11441570-26 2026-02-20T13:11:36.545 INFO:tasks.rados.rados.0.trial114.stdout:534: finishing write tid 2 to trial11441570-26 2026-02-20T13:11:36.545 INFO:tasks.rados.rados.0.trial114.stdout:544: seq_num 248 ranges {568136=785048,1929299=238837} 2026-02-20T13:11:36.549 INFO:tasks.rados.rados.0.trial114.stdout:544: writing trial11441570-18 from 568136 to 1353184 tid 1 2026-02-20T13:11:36.553 INFO:tasks.rados.rados.0.trial114.stdout:544: writing trial11441570-18 from 1929299 to 2168136 tid 2 2026-02-20T13:11:36.553 INFO:tasks.rados.rados.0.trial114.stdout:535: done (10 left) 2026-02-20T13:11:36.553 INFO:tasks.rados.rados.0.trial114.stdout:545: read oid 5 snap -1 2026-02-20T13:11:36.553 INFO:tasks.rados.rados.0.trial114.stdout:545: expect deleted 2026-02-20T13:11:36.553 INFO:tasks.rados.rados.0.trial114.stdout:546: write (excl) oid 39 current snap is 77 2026-02-20T13:11:36.553 INFO:tasks.rados.rados.0.trial114.stdout:546: seq_num 249 ranges {584943=460297,1587781=597162} 2026-02-20T13:11:36.557 INFO:tasks.rados.rados.0.trial114.stdout:546: writing trial11441570-39 from 584943 to 1045240 tid 1 2026-02-20T13:11:36.561 INFO:tasks.rados.rados.0.trial114.stdout:546: writing trial11441570-39 from 1587781 to 2184943 tid 2 2026-02-20T13:11:36.561 INFO:tasks.rados.rados.0.trial114.stdout:547: write oid 1 current snap is 77 2026-02-20T13:11:36.561 INFO:tasks.rados.rados.0.trial114.stdout:547: seq_num 250 ranges {601750=535546,1929910=271840} 2026-02-20T13:11:36.565 INFO:tasks.rados.rados.0.trial114.stdout:547: writing trial11441570-1 from 601750 to 1137296 tid 1 2026-02-20T13:11:36.571 INFO:tasks.rados.rados.0.trial114.stdout:547: writing trial11441570-1 from 1929910 to 2201750 tid 2 2026-02-20T13:11:36.571 INFO:tasks.rados.rados.0.trial114.stdout:548: snap_create 2026-02-20T13:11:36.571 INFO:tasks.rados.rados.0.trial114.stdout:536: finishing write tid 1 to trial11441570-41 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:539: finishing write tid 1 to trial11441570-17 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:537: finishing write tid 1 to trial11441570-42 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:534: finishing write tid 3 to trial11441570-26 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:534: finishing write tid 4 to trial11441570-26 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:534: oid 26 updating version 0 to 66 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:534: oid 26 version 66 is already newer than 66 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:534: oid 26 version 66 is already newer than 66 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 26 v 66 (ObjNum 240 snap 77 seq_num 240) dirty exists 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:534: left oid 26 (ObjNum 240 snap 77 seq_num 240) 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:537: finishing write tid 2 to trial11441570-42 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:536: finishing write tid 2 to trial11441570-41 2026-02-20T13:11:36.572 INFO:tasks.rados.rados.0.trial114.stdout:539: finishing write tid 2 to trial11441570-17 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:536: finishing write tid 3 to trial11441570-41 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:537: finishing write tid 3 to trial11441570-42 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:537: finishing write tid 4 to trial11441570-42 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:537: oid 42 updating version 0 to 46 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:537: oid 42 version 46 is already newer than 46 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:537: oid 42 version 46 is already newer than 46 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 42 v 46 (ObjNum 242 snap 77 seq_num 242) dirty exists 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:537: left oid 42 (ObjNum 242 snap 77 seq_num 242) 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:536: finishing write tid 4 to trial11441570-41 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:536: oid 41 updating version 0 to 100 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:536: oid 41 version 100 is already newer than 98 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:536: oid 41 version 100 is already newer than 100 2026-02-20T13:11:36.573 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 41 v 100 (ObjNum 241 snap 77 seq_num 241) dirty exists 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:536: left oid 41 (ObjNum 241 snap 77 seq_num 241) 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:539: finishing write tid 3 to trial11441570-17 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:539: finishing write tid 4 to trial11441570-17 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:539: oid 17 updating version 0 to 96 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:539: oid 17 updating version 96 to 98 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:539: oid 17 version 98 is already newer than 98 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 17 v 98 (ObjNum 244 snap 77 seq_num 244) dirty exists 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:539: left oid 17 (ObjNum 244 snap 77 seq_num 244) 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:541: finishing write tid 1 to trial11441570-9 2026-02-20T13:11:36.574 INFO:tasks.rados.rados.0.trial114.stdout:542: finishing write tid 1 to trial11441570-43 2026-02-20T13:11:36.575 INFO:tasks.rados.rados.0.trial114.stdout:542: finishing write tid 2 to trial11441570-43 2026-02-20T13:11:36.575 INFO:tasks.rados.rados.0.trial114.stdout:541: finishing write tid 2 to trial11441570-9 2026-02-20T13:11:36.575 INFO:tasks.rados.rados.0.trial114.stdout:542: finishing write tid 3 to trial11441570-43 2026-02-20T13:11:36.575 INFO:tasks.rados.rados.0.trial114.stdout:542: finishing write tid 4 to trial11441570-43 2026-02-20T13:11:36.575 INFO:tasks.rados.rados.0.trial114.stdout:542: oid 43 updating version 0 to 194 2026-02-20T13:11:36.576 INFO:tasks.rados.rados.0.trial114.stdout:542: oid 43 updating version 194 to 196 2026-02-20T13:11:36.576 INFO:tasks.rados.rados.0.trial114.stdout:542: oid 43 version 196 is already newer than 196 2026-02-20T13:11:36.576 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 43 v 196 (ObjNum 247 snap 77 seq_num 247) dirty exists 2026-02-20T13:11:36.576 INFO:tasks.rados.rados.0.trial114.stdout:542: left oid 43 (ObjNum 247 snap 77 seq_num 247) 2026-02-20T13:11:36.583 INFO:tasks.rados.rados.0.trial114.stdout:541: finishing write tid 3 to trial11441570-9 2026-02-20T13:11:36.587 INFO:tasks.rados.rados.0.trial114.stdout:544: finishing write tid 1 to trial11441570-18 2026-02-20T13:11:36.591 INFO:tasks.rados.rados.0.trial114.stdout:538: finishing write tid 1 to trial11441570-46 2026-02-20T13:11:36.591 INFO:tasks.rados.rados.0.trial114.stdout:541: finishing write tid 4 to trial11441570-9 2026-02-20T13:11:36.591 INFO:tasks.rados.rados.0.trial114.stdout:541: oid 9 updating version 0 to 114 2026-02-20T13:11:36.591 INFO:tasks.rados.rados.0.trial114.stdout:541: oid 9 version 114 is already newer than 114 2026-02-20T13:11:36.591 INFO:tasks.rados.rados.0.trial114.stdout:541: oid 9 version 114 is already newer than 112 2026-02-20T13:11:36.591 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 9 v 114 (ObjNum 246 snap 77 seq_num 246) dirty exists 2026-02-20T13:11:36.591 INFO:tasks.rados.rados.0.trial114.stdout:541: left oid 9 (ObjNum 246 snap 77 seq_num 246) 2026-02-20T13:11:36.597 INFO:tasks.rados.rados.0.trial114.stdout:546: finishing write tid 1 to trial11441570-39 2026-02-20T13:11:36.601 INFO:tasks.rados.rados.0.trial114.stdout:544: finishing write tid 2 to trial11441570-18 2026-02-20T13:11:36.602 INFO:tasks.rados.rados.0.trial114.stdout:540: finishing write tid 1 to trial11441570-10 2026-02-20T13:11:36.606 INFO:tasks.rados.rados.0.trial114.stdout:547: finishing write tid 1 to trial11441570-1 2026-02-20T13:11:36.614 INFO:tasks.rados.rados.0.trial114.stdout:544: finishing write tid 3 to trial11441570-18 2026-02-20T13:11:36.616 INFO:tasks.rados.rados.0.trial114.stdout:538: finishing write tid 2 to trial11441570-46 2026-02-20T13:11:36.618 INFO:tasks.rados.rados.0.trial114.stdout:544: finishing write tid 4 to trial11441570-18 2026-02-20T13:11:36.618 INFO:tasks.rados.rados.0.trial114.stdout:544: oid 18 updating version 0 to 70 2026-02-20T13:11:36.618 INFO:tasks.rados.rados.0.trial114.stdout:544: oid 18 version 70 is already newer than 70 2026-02-20T13:11:36.618 INFO:tasks.rados.rados.0.trial114.stdout:544: oid 18 version 70 is already newer than 70 2026-02-20T13:11:36.618 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 18 v 70 (ObjNum 248 snap 77 seq_num 248) dirty exists 2026-02-20T13:11:36.618 INFO:tasks.rados.rados.0.trial114.stdout:544: left oid 18 (ObjNum 248 snap 77 seq_num 248) 2026-02-20T13:11:36.618 INFO:tasks.rados.rados.0.trial114.stdout:547: finishing write tid 2 to trial11441570-1 2026-02-20T13:11:36.623 INFO:tasks.rados.rados.0.trial114.stdout:540: finishing write tid 2 to trial11441570-10 2026-02-20T13:11:36.626 INFO:tasks.rados.rados.0.trial114.stdout:546: finishing write tid 2 to trial11441570-39 2026-02-20T13:11:36.635 INFO:tasks.rados.rados.0.trial114.stdout:540: finishing write tid 3 to trial11441570-10 2026-02-20T13:11:36.638 INFO:tasks.rados.rados.0.trial114.stdout:546: finishing write tid 3 to trial11441570-39 2026-02-20T13:11:36.639 INFO:tasks.rados.rados.0.trial114.stdout:540: finishing write tid 4 to trial11441570-10 2026-02-20T13:11:36.639 INFO:tasks.rados.rados.0.trial114.stdout:540: oid 10 updating version 0 to 103 2026-02-20T13:11:36.639 INFO:tasks.rados.rados.0.trial114.stdout:540: oid 10 version 103 is already newer than 101 2026-02-20T13:11:36.639 INFO:tasks.rados.rados.0.trial114.stdout:540: oid 10 version 103 is already newer than 103 2026-02-20T13:11:36.639 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 10 v 103 (ObjNum 245 snap 77 seq_num 245) dirty exists 2026-02-20T13:11:36.639 INFO:tasks.rados.rados.0.trial114.stdout:540: left oid 10 (ObjNum 245 snap 77 seq_num 245) 2026-02-20T13:11:36.641 INFO:tasks.rados.rados.0.trial114.stdout:546: finishing write tid 4 to trial11441570-39 2026-02-20T13:11:36.641 INFO:tasks.rados.rados.0.trial114.stdout:546: oid 39 updating version 0 to 221 2026-02-20T13:11:36.641 INFO:tasks.rados.rados.0.trial114.stdout:546: oid 39 version 221 is already newer than 219 2026-02-20T13:11:36.642 INFO:tasks.rados.rados.0.trial114.stdout:546: oid 39 version 221 is already newer than 221 2026-02-20T13:11:36.642 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 39 v 221 (ObjNum 249 snap 77 seq_num 249) dirty exists 2026-02-20T13:11:36.642 INFO:tasks.rados.rados.0.trial114.stdout:546: left oid 39 (ObjNum 249 snap 77 seq_num 249) 2026-02-20T13:11:36.645 INFO:tasks.rados.rados.0.trial114.stdout:538: finishing write tid 3 to trial11441570-46 2026-02-20T13:11:36.647 INFO:tasks.rados.rados.0.trial114.stdout:538: finishing write tid 4 to trial11441570-46 2026-02-20T13:11:36.648 INFO:tasks.rados.rados.0.trial114.stdout:538: oid 46 updating version 0 to 102 2026-02-20T13:11:36.648 INFO:tasks.rados.rados.0.trial114.stdout:538: oid 46 updating version 102 to 104 2026-02-20T13:11:36.648 INFO:tasks.rados.rados.0.trial114.stdout:538: oid 46 version 104 is already newer than 104 2026-02-20T13:11:36.648 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 46 v 104 (ObjNum 243 snap 77 seq_num 243) dirty exists 2026-02-20T13:11:36.648 INFO:tasks.rados.rados.0.trial114.stdout:538: left oid 46 (ObjNum 243 snap 77 seq_num 243) 2026-02-20T13:11:36.649 INFO:tasks.rados.rados.0.trial114.stdout:547: finishing write tid 3 to trial11441570-1 2026-02-20T13:11:36.650 INFO:tasks.rados.rados.0.trial114.stdout:547: finishing write tid 4 to trial11441570-1 2026-02-20T13:11:36.650 INFO:tasks.rados.rados.0.trial114.stdout:547: oid 1 updating version 0 to 102 2026-02-20T13:11:36.650 INFO:tasks.rados.rados.0.trial114.stdout:547: oid 1 version 102 is already newer than 102 2026-02-20T13:11:36.650 INFO:tasks.rados.rados.0.trial114.stdout:547: oid 1 version 102 is already newer than 102 2026-02-20T13:11:36.650 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 1 v 102 (ObjNum 250 snap 77 seq_num 250) dirty exists 2026-02-20T13:11:36.650 INFO:tasks.rados.rados.0.trial114.stdout:547: left oid 1 (ObjNum 250 snap 77 seq_num 250) 2026-02-20T13:11:36.695 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:36.770 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:36.765+0000 7f5e5fe8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:36.772 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:36.768+0000 7f5e5fe8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:36.799 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:36.816 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:36.817 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:36.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~132s 2026-02-20T13:11:37.407 INFO:tasks.rados.rados.0.trial114.stdout:534: done (13 left) 2026-02-20T13:11:37.407 INFO:tasks.rados.rados.0.trial114.stdout:536: done (12 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:537: done (11 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:538: done (10 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:539: done (9 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:540: done (8 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:541: done (7 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:542: done (6 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:543: done (5 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:544: done (4 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:545: done (3 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:546: done (2 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:547: done (1 left) 2026-02-20T13:11:37.408 INFO:tasks.rados.rados.0.trial114.stdout:548: done (0 left) 2026-02-20T13:11:37.409 INFO:tasks.rados.rados.0.trial114.stdout:549: delete oid 31 current snap is 78 2026-02-20T13:11:37.421 INFO:tasks.rados.rados.0.trial114.stdout:549: done (0 left) 2026-02-20T13:11:37.421 INFO:tasks.rados.rados.0.trial114.stdout:550: snap_create 2026-02-20T13:11:38.411 INFO:tasks.rados.rados.0.trial114.stdout:550: done (0 left) 2026-02-20T13:11:38.411 INFO:tasks.rados.rados.0.trial114.stdout:551: write oid 17 current snap is 79 2026-02-20T13:11:38.411 INFO:tasks.rados.rados.0.trial114.stdout:551: seq_num 252 ranges {635364=402397,1763227=472137} 2026-02-20T13:11:38.415 INFO:tasks.rados.rados.0.trial114.stdout:551: writing trial11441570-17 from 635364 to 1037761 tid 1 2026-02-20T13:11:38.420 INFO:tasks.rados.rados.0.trial114.stdout:551: writing trial11441570-17 from 1763227 to 2235364 tid 2 2026-02-20T13:11:38.420 INFO:tasks.rados.rados.0.trial114.stdout:552: write oid 21 current snap is 79 2026-02-20T13:11:38.420 INFO:tasks.rados.rados.0.trial114.stdout:552: seq_num 253 ranges {652171=477646,1821709=430462} 2026-02-20T13:11:38.424 INFO:tasks.rados.rados.0.trial114.stdout:552: writing trial11441570-21 from 652171 to 1129817 tid 1 2026-02-20T13:11:38.428 INFO:tasks.rados.rados.0.trial114.stdout:552: writing trial11441570-21 from 1821709 to 2252171 tid 2 2026-02-20T13:11:38.428 INFO:tasks.rados.rados.0.trial114.stdout:553: write (excl) oid 16 current snap is 79 2026-02-20T13:11:38.428 INFO:tasks.rados.rados.0.trial114.stdout:553: seq_num 254 ranges {668978=552895,1763838=505140} 2026-02-20T13:11:38.433 INFO:tasks.rados.rados.0.trial114.stdout:553: writing trial11441570-16 from 668978 to 1221873 tid 1 2026-02-20T13:11:38.437 INFO:tasks.rados.rados.0.trial114.stdout:553: writing trial11441570-16 from 1763838 to 2268978 tid 2 2026-02-20T13:11:38.437 INFO:tasks.rados.rados.0.trial114.stdout:554: write (excl) oid 25 current snap is 79 2026-02-20T13:11:38.437 INFO:tasks.rados.rados.0.trial114.stdout:554: seq_num 255 ranges {685785=628144,1822320=463465} 2026-02-20T13:11:38.442 INFO:tasks.rados.rados.0.trial114.stdout:554: writing trial11441570-25 from 685785 to 1313929 tid 1 2026-02-20T13:11:38.446 INFO:tasks.rados.rados.0.trial114.stdout:554: writing trial11441570-25 from 1822320 to 2285785 tid 2 2026-02-20T13:11:38.446 INFO:tasks.rados.rados.0.trial114.stdout:555: write oid 47 current snap is 79 2026-02-20T13:11:38.446 INFO:tasks.rados.rados.0.trial114.stdout:555: seq_num 256 ranges {702592=703393,1880802=421790} 2026-02-20T13:11:38.451 INFO:tasks.rados.rados.0.trial114.stdout:555: writing trial11441570-47 from 702592 to 1405985 tid 1 2026-02-20T13:11:38.454 INFO:tasks.rados.rados.0.trial114.stdout:555: writing trial11441570-47 from 1880802 to 2302592 tid 2 2026-02-20T13:11:38.454 INFO:tasks.rados.rados.0.trial114.stdout:556: delete oid 22 current snap is 79 2026-02-20T13:11:38.454 INFO:tasks.rados.rados.0.trial114.stdout:552: finishing write tid 1 to trial11441570-21 2026-02-20T13:11:38.458 INFO:tasks.rados.rados.0.trial114.stdout:551: finishing write tid 1 to trial11441570-17 2026-02-20T13:11:38.458 INFO:tasks.rados.rados.0.trial114.stdout:552: finishing write tid 2 to trial11441570-21 2026-02-20T13:11:38.462 INFO:tasks.rados.rados.0.trial114.stdout:551: finishing write tid 2 to trial11441570-17 2026-02-20T13:11:38.469 INFO:tasks.rados.rados.0.trial114.stdout:551: finishing write tid 3 to trial11441570-17 2026-02-20T13:11:38.471 INFO:tasks.rados.rados.0.trial114.stdout:551: finishing write tid 4 to trial11441570-17 2026-02-20T13:11:38.471 INFO:tasks.rados.rados.0.trial114.stdout:551: oid 17 updating version 0 to 106 2026-02-20T13:11:38.471 INFO:tasks.rados.rados.0.trial114.stdout:551: oid 17 version 106 is already newer than 106 2026-02-20T13:11:38.471 INFO:tasks.rados.rados.0.trial114.stdout:551: oid 17 version 106 is already newer than 106 2026-02-20T13:11:38.471 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 17 v 106 (ObjNum 252 snap 79 seq_num 252) dirty exists 2026-02-20T13:11:38.471 INFO:tasks.rados.rados.0.trial114.stdout:551: left oid 17 (ObjNum 252 snap 79 seq_num 252) 2026-02-20T13:11:38.472 INFO:tasks.rados.rados.0.trial114.stdout:552: finishing write tid 3 to trial11441570-21 2026-02-20T13:11:38.475 INFO:tasks.rados.rados.0.trial114.stdout:552: finishing write tid 4 to trial11441570-21 2026-02-20T13:11:38.475 INFO:tasks.rados.rados.0.trial114.stdout:552: oid 21 updating version 0 to 31 2026-02-20T13:11:38.475 INFO:tasks.rados.rados.0.trial114.stdout:552: oid 21 version 31 is already newer than 31 2026-02-20T13:11:38.475 INFO:tasks.rados.rados.0.trial114.stdout:552: oid 21 version 31 is already newer than 31 2026-02-20T13:11:38.475 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 21 v 31 (ObjNum 253 snap 79 seq_num 253) dirty exists 2026-02-20T13:11:38.475 INFO:tasks.rados.rados.0.trial114.stdout:552: left oid 21 (ObjNum 253 snap 79 seq_num 253) 2026-02-20T13:11:38.487 INFO:tasks.rados.rados.0.trial114.stdout:555: finishing write tid 1 to trial11441570-47 2026-02-20T13:11:38.496 INFO:tasks.rados.rados.0.trial114.stdout:555: finishing write tid 2 to trial11441570-47 2026-02-20T13:11:38.503 INFO:tasks.rados.rados.0.trial114.stdout:555: finishing write tid 3 to trial11441570-47 2026-02-20T13:11:38.505 INFO:tasks.rados.rados.0.trial114.stdout:555: finishing write tid 4 to trial11441570-47 2026-02-20T13:11:38.505 INFO:tasks.rados.rados.0.trial114.stdout:555: oid 47 updating version 0 to 36 2026-02-20T13:11:38.506 INFO:tasks.rados.rados.0.trial114.stdout:555: oid 47 version 36 is already newer than 36 2026-02-20T13:11:38.506 INFO:tasks.rados.rados.0.trial114.stdout:555: oid 47 version 36 is already newer than 36 2026-02-20T13:11:38.506 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 47 v 36 (ObjNum 256 snap 79 seq_num 256) dirty exists 2026-02-20T13:11:38.506 INFO:tasks.rados.rados.0.trial114.stdout:555: left oid 47 (ObjNum 256 snap 79 seq_num 256) 2026-02-20T13:11:38.524 INFO:tasks.rados.rados.0.trial114.stdout:553: finishing write tid 1 to trial11441570-16 2026-02-20T13:11:38.540 INFO:tasks.rados.rados.0.trial114.stdout:553: finishing write tid 2 to trial11441570-16 2026-02-20T13:11:38.551 INFO:tasks.rados.rados.0.trial114.stdout:553: finishing write tid 3 to trial11441570-16 2026-02-20T13:11:38.552 INFO:tasks.rados.rados.0.trial114.stdout:553: finishing write tid 4 to trial11441570-16 2026-02-20T13:11:38.552 INFO:tasks.rados.rados.0.trial114.stdout:553: oid 16 updating version 0 to 48 2026-02-20T13:11:38.552 INFO:tasks.rados.rados.0.trial114.stdout:553: oid 16 version 48 is already newer than 48 2026-02-20T13:11:38.552 INFO:tasks.rados.rados.0.trial114.stdout:553: oid 16 version 48 is already newer than 46 2026-02-20T13:11:38.552 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 16 v 48 (ObjNum 254 snap 79 seq_num 254) dirty exists 2026-02-20T13:11:38.552 INFO:tasks.rados.rados.0.trial114.stdout:553: left oid 16 (ObjNum 254 snap 79 seq_num 254) 2026-02-20T13:11:38.565 INFO:tasks.rados.rados.0.trial114.stdout:554: finishing write tid 1 to trial11441570-25 2026-02-20T13:11:38.581 INFO:tasks.rados.rados.0.trial114.stdout:554: finishing write tid 2 to trial11441570-25 2026-02-20T13:11:38.589 INFO:tasks.rados.rados.0.trial114.stdout:554: finishing write tid 3 to trial11441570-25 2026-02-20T13:11:38.592 INFO:tasks.rados.rados.0.trial114.stdout:554: finishing write tid 4 to trial11441570-25 2026-02-20T13:11:38.592 INFO:tasks.rados.rados.0.trial114.stdout:554: oid 25 updating version 0 to 116 2026-02-20T13:11:38.593 INFO:tasks.rados.rados.0.trial114.stdout:554: oid 25 version 116 is already newer than 116 2026-02-20T13:11:38.593 INFO:tasks.rados.rados.0.trial114.stdout:554: oid 25 version 116 is already newer than 114 2026-02-20T13:11:38.593 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 25 v 116 (ObjNum 255 snap 79 seq_num 255) dirty exists 2026-02-20T13:11:38.593 INFO:tasks.rados.rados.0.trial114.stdout:554: left oid 25 (ObjNum 255 snap 79 seq_num 255) 2026-02-20T13:11:38.605 INFO:tasks.rados.rados.0.trial114.stdout:551: done (5 left) 2026-02-20T13:11:38.605 INFO:tasks.rados.rados.0.trial114.stdout:552: done (4 left) 2026-02-20T13:11:38.605 INFO:tasks.rados.rados.0.trial114.stdout:553: done (3 left) 2026-02-20T13:11:38.605 INFO:tasks.rados.rados.0.trial114.stdout:554: done (2 left) 2026-02-20T13:11:38.606 INFO:tasks.rados.rados.0.trial114.stdout:555: done (1 left) 2026-02-20T13:11:38.606 INFO:tasks.rados.rados.0.trial114.stdout:556: done (0 left) 2026-02-20T13:11:38.606 INFO:tasks.rados.rados.0.trial114.stdout:557: delete oid 9 current snap is 79 2026-02-20T13:11:38.632 INFO:tasks.rados.rados.0.trial114.stdout:557: done (0 left) 2026-02-20T13:11:38.632 INFO:tasks.rados.rados.0.trial114.stdout:558: delete oid 10 current snap is 79 2026-02-20T13:11:38.656 INFO:tasks.rados.rados.0.trial114.stdout:558: done (0 left) 2026-02-20T13:11:38.656 INFO:tasks.rados.rados.0.trial114.stdout:559: read oid 36 snap 68 2026-02-20T13:11:38.656 INFO:tasks.rados.rados.0.trial114.stdout:559: expect deleted 2026-02-20T13:11:38.656 INFO:tasks.rados.rados.0.trial114.stdout:560: snap_remove snap 70 2026-02-20T13:11:38.818 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:38.894 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:38.889+0000 7f47bc88b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:38.896 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:38.893+0000 7f47bc88b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:38.923 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:38.939 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:38.940 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:39.377 INFO:tasks.rados.rados.0.trial114.stdout:560: done (1 left) 2026-02-20T13:11:39.377 INFO:tasks.rados.rados.0.trial114.stdout:561: snap_remove snap 67 2026-02-20T13:11:40.381 INFO:tasks.rados.rados.0.trial114.stdout:561: done (1 left) 2026-02-20T13:11:40.381 INFO:tasks.rados.rados.0.trial114.stdout:562: snap_create 2026-02-20T13:11:40.674 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:40.746 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:40.749 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:40.750 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:40.941 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:41.018 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:41.014+0000 7f92f256f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:41.020 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:41.018+0000 7f92f256f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:41.047 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:41.064 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:41.065 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:41.382 INFO:tasks.rados.rados.0.trial114.stdout:559: done (1 left) 2026-02-20T13:11:41.382 INFO:tasks.rados.rados.0.trial114.stdout:562: done (0 left) 2026-02-20T13:11:41.382 INFO:tasks.rados.rados.0.trial114.stdout:563: snap_remove snap 77 2026-02-20T13:11:42.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~138s 2026-02-20T13:11:42.386 INFO:tasks.rados.rados.0.trial114.stdout:563: done (0 left) 2026-02-20T13:11:42.386 INFO:tasks.rados.rados.0.trial114.stdout:564: write oid 9 current snap is 80 2026-02-20T13:11:42.387 INFO:tasks.rados.rados.0.trial114.stdout:564: seq_num 260 ranges {769820=720742,2114730=255090} 2026-02-20T13:11:42.392 INFO:tasks.rados.rados.0.trial114.stdout:564: writing trial11441570-9 from 769820 to 1490562 tid 1 2026-02-20T13:11:42.396 INFO:tasks.rados.rados.0.trial114.stdout:564: writing trial11441570-9 from 2114730 to 2369820 tid 2 2026-02-20T13:11:42.396 INFO:tasks.rados.rados.0.trial114.stdout:565: read oid 33 snap -1 2026-02-20T13:11:42.396 INFO:tasks.rados.rados.0.trial114.stdout:565: expect deleted 2026-02-20T13:11:42.396 INFO:tasks.rados.rados.0.trial114.stdout:566: delete oid 41 current snap is 80 2026-02-20T13:11:42.427 INFO:tasks.rados.rados.0.trial114.stdout:564: finishing write tid 1 to trial11441570-9 2026-02-20T13:11:42.433 INFO:tasks.rados.rados.0.trial114.stdout:564: finishing write tid 2 to trial11441570-9 2026-02-20T13:11:42.433 INFO:tasks.rados.rados.0.trial114.stdout:565: done (2 left) 2026-02-20T13:11:42.433 INFO:tasks.rados.rados.0.trial114.stdout:566: done (1 left) 2026-02-20T13:11:42.433 INFO:tasks.rados.rados.0.trial114.stdout:567: write oid 41 current snap is 80 2026-02-20T13:11:42.433 INFO:tasks.rados.rados.0.trial114.stdout:567: seq_num 262 ranges {403434=471240,1315341=400756} 2026-02-20T13:11:42.437 INFO:tasks.rados.rados.0.trial114.stdout:567: writing trial11441570-41 from 403434 to 874674 tid 1 2026-02-20T13:11:42.440 INFO:tasks.rados.rados.0.trial114.stdout:567: writing trial11441570-41 from 1315341 to 1716097 tid 2 2026-02-20T13:11:42.441 INFO:tasks.rados.rados.0.trial114.stdout:568: snap_create 2026-02-20T13:11:42.441 INFO:tasks.rados.rados.0.trial114.stdout:564: finishing write tid 3 to trial11441570-9 2026-02-20T13:11:42.441 INFO:tasks.rados.rados.0.trial114.stdout:564: finishing write tid 4 to trial11441570-9 2026-02-20T13:11:42.441 INFO:tasks.rados.rados.0.trial114.stdout:564: oid 9 updating version 0 to 119 2026-02-20T13:11:42.441 INFO:tasks.rados.rados.0.trial114.stdout:564: oid 9 version 119 is already newer than 119 2026-02-20T13:11:42.441 INFO:tasks.rados.rados.0.trial114.stdout:564: oid 9 version 119 is already newer than 119 2026-02-20T13:11:42.441 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 9 v 119 (ObjNum 260 snap 80 seq_num 260) dirty exists 2026-02-20T13:11:42.441 INFO:tasks.rados.rados.0.trial114.stdout:564: left oid 9 (ObjNum 260 snap 80 seq_num 260) 2026-02-20T13:11:42.453 INFO:tasks.rados.rados.0.trial114.stdout:567: finishing write tid 1 to trial11441570-41 2026-02-20T13:11:42.459 INFO:tasks.rados.rados.0.trial114.stdout:567: finishing write tid 2 to trial11441570-41 2026-02-20T13:11:42.464 INFO:tasks.rados.rados.0.trial114.stdout:567: finishing write tid 3 to trial11441570-41 2026-02-20T13:11:42.466 INFO:tasks.rados.rados.0.trial114.stdout:567: finishing write tid 4 to trial11441570-41 2026-02-20T13:11:42.466 INFO:tasks.rados.rados.0.trial114.stdout:567: oid 41 updating version 0 to 109 2026-02-20T13:11:42.466 INFO:tasks.rados.rados.0.trial114.stdout:567: oid 41 version 109 is already newer than 109 2026-02-20T13:11:42.466 INFO:tasks.rados.rados.0.trial114.stdout:567: oid 41 version 109 is already newer than 109 2026-02-20T13:11:42.466 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 41 v 109 (ObjNum 262 snap 80 seq_num 262) dirty exists 2026-02-20T13:11:42.466 INFO:tasks.rados.rados.0.trial114.stdout:567: left oid 41 (ObjNum 262 snap 80 seq_num 262) 2026-02-20T13:11:43.066 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:43.142 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:43.138+0000 7f5440011640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:43.144 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:43.141+0000 7f543ed88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:43.170 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:43.188 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:43.188 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:43.392 INFO:tasks.rados.rados.0.trial114.stdout:564: done (2 left) 2026-02-20T13:11:43.392 INFO:tasks.rados.rados.0.trial114.stdout:567: done (1 left) 2026-02-20T13:11:43.392 INFO:tasks.rados.rados.0.trial114.stdout:568: done (0 left) 2026-02-20T13:11:43.392 INFO:tasks.rados.rados.0.trial114.stdout:569: read oid 42 snap -1 2026-02-20T13:11:43.392 INFO:tasks.rados.rados.0.trial114.stdout:569: expect (ObjNum 242 snap 77 seq_num 242) 2026-02-20T13:11:43.393 INFO:tasks.rados.rados.0.trial114.stdout:570: snap_remove snap 71 2026-02-20T13:11:44.395 INFO:tasks.rados.rados.0.trial114.stdout:570: done (1 left) 2026-02-20T13:11:44.395 INFO:tasks.rados.rados.0.trial114.stdout:571: delete oid 35 current snap is 81 2026-02-20T13:11:44.395 INFO:tasks.rados.rados.0.trial114.stdout:569: expect (ObjNum 242 snap 77 seq_num 242) 2026-02-20T13:11:44.395 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:44.439 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:44.461 INFO:tasks.rados.rados.0.trial114.stdout:569: done (1 left) 2026-02-20T13:11:44.462 INFO:tasks.rados.rados.0.trial114.stdout:571: done (0 left) 2026-02-20T13:11:44.462 INFO:tasks.rados.rados.0.trial114.stdout:572: delete oid 37 current snap is 81 2026-02-20T13:11:44.488 INFO:tasks.rados.rados.0.trial114.stdout:572: done (0 left) 2026-02-20T13:11:44.488 INFO:tasks.rados.rados.0.trial114.stdout:573: delete oid 15 current snap is 81 2026-02-20T13:11:44.496 INFO:tasks.rados.rados.0.trial114.stdout:573: done (0 left) 2026-02-20T13:11:44.496 INFO:tasks.rados.rados.0.trial114.stdout:574: read oid 44 snap -1 2026-02-20T13:11:44.496 INFO:tasks.rados.rados.0.trial114.stdout:574: expect (ObjNum 238 snap 76 seq_num 238) 2026-02-20T13:11:44.496 INFO:tasks.rados.rados.0.trial114.stdout:575: snap_create 2026-02-20T13:11:44.513 INFO:tasks.rados.rados.0.trial114.stdout:574: expect (ObjNum 238 snap 76 seq_num 238) 2026-02-20T13:11:44.546 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:45.189 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:45.265 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:45.261+0000 7f0211051640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:45.267 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:45.265+0000 7f0211051640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:45.293 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:45.309 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:45.309 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:45.403 INFO:tasks.rados.rados.0.trial114.stdout:574: done (1 left) 2026-02-20T13:11:45.403 INFO:tasks.rados.rados.0.trial114.stdout:575: done (0 left) 2026-02-20T13:11:45.403 INFO:tasks.rados.rados.0.trial114.stdout:576: delete oid 37 current snap is 82 2026-02-20T13:11:45.419 INFO:tasks.rados.rados.0.trial114.stdout:576: done (0 left) 2026-02-20T13:11:45.419 INFO:tasks.rados.rados.0.trial114.stdout:577: read oid 47 snap -1 2026-02-20T13:11:45.419 INFO:tasks.rados.rados.0.trial114.stdout:577: expect (ObjNum 256 snap 79 seq_num 256) 2026-02-20T13:11:45.419 INFO:tasks.rados.rados.0.trial114.stdout:578: delete oid 6 current snap is 82 2026-02-20T13:11:45.432 INFO:tasks.rados.rados.0.trial114.stdout:577: expect (ObjNum 256 snap 79 seq_num 256) 2026-02-20T13:11:45.452 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:45.491 INFO:tasks.rados.rados.0.trial114.stdout:577: done (1 left) 2026-02-20T13:11:45.491 INFO:tasks.rados.rados.0.trial114.stdout:578: done (0 left) 2026-02-20T13:11:45.491 INFO:tasks.rados.rados.0.trial114.stdout:579: snap_remove snap 59 2026-02-20T13:11:45.750 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:45.822 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:45.825 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:45.826 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:46.408 INFO:tasks.rados.rados.0.trial114.stdout:579: done (0 left) 2026-02-20T13:11:46.408 INFO:tasks.rados.rados.0.trial114.stdout:580: read oid 44 snap -1 2026-02-20T13:11:46.408 INFO:tasks.rados.rados.0.trial114.stdout:580: expect (ObjNum 238 snap 76 seq_num 238) 2026-02-20T13:11:46.408 INFO:tasks.rados.rados.0.trial114.stdout:581: snap_remove snap 74 2026-02-20T13:11:47.310 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:47.389 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:47.386+0000 7f32ce55b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:47.392 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:47.389+0000 7f32ce55b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:47.408 INFO:tasks.rados.rados.0.trial114.stdout:581: done (1 left) 2026-02-20T13:11:47.408 INFO:tasks.rados.rados.0.trial114.stdout:582: write (excl) oid 43 current snap is 82 2026-02-20T13:11:47.408 INFO:tasks.rados.rados.0.trial114.stdout:582: seq_num 268 ranges {504276=639087,1666233=695410} 2026-02-20T13:11:47.412 INFO:tasks.rados.rados.0.trial114.stdout:582: writing trial11441570-43 from 504276 to 1143363 tid 1 2026-02-20T13:11:47.417 INFO:tasks.rados.rados.0.trial114.stdout:582: writing trial11441570-43 from 1666233 to 2361643 tid 2 2026-02-20T13:11:47.417 INFO:tasks.rados.rados.0.trial114.stdout:583: write oid 4 current snap is 82 2026-02-20T13:11:47.417 INFO:tasks.rados.rados.0.trial114.stdout:583: seq_num 269 ranges {521083=714336,1724715=555421} 2026-02-20T13:11:47.422 INFO:tasks.rados.rados.0.trial114.stdout:583: writing trial11441570-4 from 521083 to 1235419 tid 1 2026-02-20T13:11:47.426 INFO:tasks.rados.rados.0.trial114.stdout:583: writing trial11441570-4 from 1724715 to 2280136 tid 2 2026-02-20T13:11:47.426 INFO:tasks.rados.rados.0.trial114.stdout:580: expect (ObjNum 238 snap 76 seq_num 238) 2026-02-20T13:11:47.436 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:47.462 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:47.463 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:47.471 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:47.494 INFO:tasks.rados.rados.0.trial114.stdout:584: read oid 29 snap -1 2026-02-20T13:11:47.494 INFO:tasks.rados.rados.0.trial114.stdout:584: expect (ObjNum 189 snap 57 seq_num 189) 2026-02-20T13:11:47.494 INFO:tasks.rados.rados.0.trial114.stdout:580: done (3 left) 2026-02-20T13:11:47.494 INFO:tasks.rados.rados.0.trial114.stdout:585: delete oid 13 current snap is 82 2026-02-20T13:11:47.494 INFO:tasks.rados.rados.0.trial114.stdout:583: finishing write tid 1 to trial11441570-4 2026-02-20T13:11:47.494 INFO:tasks.rados.rados.0.trial114.stdout:582: finishing write tid 1 to trial11441570-43 2026-02-20T13:11:47.494 INFO:tasks.rados.rados.0.trial114.stdout:583: finishing write tid 2 to trial11441570-4 2026-02-20T13:11:47.494 INFO:tasks.rados.rados.0.trial114.stdout:583: finishing write tid 3 to trial11441570-4 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:583: finishing write tid 4 to trial11441570-4 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:583: oid 4 updating version 0 to 34 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:583: oid 4 version 34 is already newer than 34 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:583: oid 4 version 34 is already newer than 34 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 4 v 34 (ObjNum 269 snap 82 seq_num 269) dirty exists 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:583: left oid 4 (ObjNum 269 snap 82 seq_num 269) 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:582: finishing write tid 2 to trial11441570-43 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:582: finishing write tid 3 to trial11441570-43 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:582: finishing write tid 4 to trial11441570-43 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:582: oid 43 updating version 0 to 220 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:582: oid 43 version 220 is already newer than 218 2026-02-20T13:11:47.495 INFO:tasks.rados.rados.0.trial114.stdout:582: oid 43 version 220 is already newer than 220 2026-02-20T13:11:47.496 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 43 v 220 (ObjNum 268 snap 82 seq_num 268) dirty exists 2026-02-20T13:11:47.496 INFO:tasks.rados.rados.0.trial114.stdout:582: left oid 43 (ObjNum 268 snap 82 seq_num 268) 2026-02-20T13:11:47.501 INFO:tasks.rados.rados.0.trial114.stdout:582: done (3 left) 2026-02-20T13:11:47.502 INFO:tasks.rados.rados.0.trial114.stdout:583: done (2 left) 2026-02-20T13:11:47.502 INFO:tasks.rados.rados.0.trial114.stdout:585: done (1 left) 2026-02-20T13:11:47.502 INFO:tasks.rados.rados.0.trial114.stdout:586: read oid 9 snap -1 2026-02-20T13:11:47.502 INFO:tasks.rados.rados.0.trial114.stdout:586: expect (ObjNum 260 snap 80 seq_num 260) 2026-02-20T13:11:47.502 INFO:tasks.rados.rados.0.trial114.stdout:587: snap_create 2026-02-20T13:11:47.517 INFO:tasks.rados.rados.0.trial114.stdout:584: expect (ObjNum 189 snap 57 seq_num 189) 2026-02-20T13:11:47.608 INFO:tasks.rados.rados.0.trial114.stdout:586: expect (ObjNum 260 snap 80 seq_num 260) 2026-02-20T13:11:47.618 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:47.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~143s 2026-02-20T13:11:48.414 INFO:tasks.rados.rados.0.trial114.stdout:584: done (2 left) 2026-02-20T13:11:48.414 INFO:tasks.rados.rados.0.trial114.stdout:586: done (1 left) 2026-02-20T13:11:48.414 INFO:tasks.rados.rados.0.trial114.stdout:587: done (0 left) 2026-02-20T13:11:48.414 INFO:tasks.rados.rados.0.trial114.stdout:588: delete oid 26 current snap is 83 2026-02-20T13:11:48.460 INFO:tasks.rados.rados.0.trial114.stdout:588: done (0 left) 2026-02-20T13:11:48.460 INFO:tasks.rados.rados.0.trial114.stdout:589: write (excl) oid 12 current snap is 83 2026-02-20T13:11:48.460 INFO:tasks.rados.rados.0.trial114.stdout:589: seq_num 272 ranges {571504=540083,1783808=702748} 2026-02-20T13:11:48.464 INFO:tasks.rados.rados.0.trial114.stdout:589: writing trial11441570-12 from 571504 to 1111587 tid 1 2026-02-20T13:11:48.470 INFO:tasks.rados.rados.0.trial114.stdout:589: writing trial11441570-12 from 1783808 to 2486556 tid 2 2026-02-20T13:11:48.470 INFO:tasks.rados.rados.0.trial114.stdout:590: snap_create 2026-02-20T13:11:48.492 INFO:tasks.rados.rados.0.trial114.stdout:589: finishing write tid 1 to trial11441570-12 2026-02-20T13:11:48.505 INFO:tasks.rados.rados.0.trial114.stdout:589: finishing write tid 2 to trial11441570-12 2026-02-20T13:11:48.509 INFO:tasks.rados.rados.0.trial114.stdout:589: finishing write tid 3 to trial11441570-12 2026-02-20T13:11:48.510 INFO:tasks.rados.rados.0.trial114.stdout:589: finishing write tid 4 to trial11441570-12 2026-02-20T13:11:48.511 INFO:tasks.rados.rados.0.trial114.stdout:589: oid 12 updating version 0 to 125 2026-02-20T13:11:48.511 INFO:tasks.rados.rados.0.trial114.stdout:589: oid 12 version 125 is already newer than 123 2026-02-20T13:11:48.511 INFO:tasks.rados.rados.0.trial114.stdout:589: oid 12 version 125 is already newer than 125 2026-02-20T13:11:48.511 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 12 v 125 (ObjNum 272 snap 83 seq_num 272) dirty exists 2026-02-20T13:11:48.511 INFO:tasks.rados.rados.0.trial114.stdout:589: left oid 12 (ObjNum 272 snap 83 seq_num 272) 2026-02-20T13:11:49.379 INFO:tasks.rados.rados.0.trial114.stdout:589: done (1 left) 2026-02-20T13:11:49.379 INFO:tasks.rados.rados.0.trial114.stdout:590: done (0 left) 2026-02-20T13:11:49.379 INFO:tasks.rados.rados.0.trial114.stdout:591: delete oid 23 current snap is 84 2026-02-20T13:11:49.399 INFO:tasks.rados.rados.0.trial114.stdout:591: done (0 left) 2026-02-20T13:11:49.400 INFO:tasks.rados.rados.0.trial114.stdout:592: delete oid 27 current snap is 84 2026-02-20T13:11:49.430 INFO:tasks.rados.rados.0.trial114.stdout:592: done (0 left) 2026-02-20T13:11:49.430 INFO:tasks.rados.rados.0.trial114.stdout:593: delete oid 18 current snap is 84 2026-02-20T13:11:49.457 INFO:tasks.rados.rados.0.trial114.stdout:593: done (0 left) 2026-02-20T13:11:49.457 INFO:tasks.rados.rados.0.trial114.stdout:594: delete oid 39 current snap is 84 2026-02-20T13:11:49.464 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:49.489 INFO:tasks.rados.rados.0.trial114.stdout:594: done (0 left) 2026-02-20T13:11:49.490 INFO:tasks.rados.rados.0.trial114.stdout:595: snap_remove snap 79 2026-02-20T13:11:49.540 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:49.537+0000 7fcf4110b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:49.543 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:49.540+0000 7fcf4110b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:49.570 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:49.585 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:49.585 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:50.419 INFO:tasks.rados.rados.0.trial114.stdout:595: done (0 left) 2026-02-20T13:11:50.419 INFO:tasks.rados.rados.0.trial114.stdout:596: read oid 6 snap -1 2026-02-20T13:11:50.419 INFO:tasks.rados.rados.0.trial114.stdout:596: expect deleted 2026-02-20T13:11:50.419 INFO:tasks.rados.rados.0.trial114.stdout:597: read oid 35 snap -1 2026-02-20T13:11:50.419 INFO:tasks.rados.rados.0.trial114.stdout:597: expect deleted 2026-02-20T13:11:50.420 INFO:tasks.rados.rados.0.trial114.stdout:598: snap_remove snap 83 2026-02-20T13:11:50.827 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:50.899 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:50.901 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:50.902 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:51.420 INFO:tasks.rados.rados.0.trial114.stdout:598: done (2 left) 2026-02-20T13:11:51.421 INFO:tasks.rados.rados.0.trial114.stdout:599: write (excl) oid 38 current snap is 84 2026-02-20T13:11:51.421 INFO:tasks.rados.rados.0.trial114.stdout:599: seq_num 277 ranges {655539=632681,2076218=570097} 2026-02-20T13:11:51.425 INFO:tasks.rados.rados.0.trial114.stdout:599: writing trial11441570-38 from 655539 to 1288220 tid 1 2026-02-20T13:11:51.431 INFO:tasks.rados.rados.0.trial114.stdout:599: writing trial11441570-38 from 2076218 to 2646315 tid 2 2026-02-20T13:11:51.431 INFO:tasks.rados.rados.0.trial114.stdout:600: snap_remove snap 72 2026-02-20T13:11:51.587 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:51.663 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:51.660+0000 7fd4b665a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:51.666 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:51.663+0000 7fd4b665a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:51.694 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:51.709 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:51.709 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:52.427 INFO:tasks.rados.rados.0.trial114.stdout:600: done (3 left) 2026-02-20T13:11:52.427 INFO:tasks.rados.rados.0.trial114.stdout:601: snap_create 2026-02-20T13:11:52.427 INFO:tasks.rados.rados.0.trial114.stdout:599: finishing write tid 1 to trial11441570-38 2026-02-20T13:11:52.427 INFO:tasks.rados.rados.0.trial114.stdout:599: finishing write tid 2 to trial11441570-38 2026-02-20T13:11:52.427 INFO:tasks.rados.rados.0.trial114.stdout:599: finishing write tid 3 to trial11441570-38 2026-02-20T13:11:52.427 INFO:tasks.rados.rados.0.trial114.stdout:599: finishing write tid 4 to trial11441570-38 2026-02-20T13:11:52.427 INFO:tasks.rados.rados.0.trial114.stdout:599: oid 38 updating version 0 to 114 2026-02-20T13:11:52.427 INFO:tasks.rados.rados.0.trial114.stdout:599: oid 38 version 114 is already newer than 112 2026-02-20T13:11:52.428 INFO:tasks.rados.rados.0.trial114.stdout:599: oid 38 version 114 is already newer than 114 2026-02-20T13:11:52.428 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 38 v 114 (ObjNum 277 snap 84 seq_num 277) dirty exists 2026-02-20T13:11:52.428 INFO:tasks.rados.rados.0.trial114.stdout:599: left oid 38 (ObjNum 277 snap 84 seq_num 277) 2026-02-20T13:11:53.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~149s 2026-02-20T13:11:53.427 INFO:tasks.rados.rados.0.trial114.stdout:596: done (3 left) 2026-02-20T13:11:53.427 INFO:tasks.rados.rados.0.trial114.stdout:597: done (2 left) 2026-02-20T13:11:53.428 INFO:tasks.rados.rados.0.trial114.stdout:599: done (1 left) 2026-02-20T13:11:53.428 INFO:tasks.rados.rados.0.trial114.stdout:601: done (0 left) 2026-02-20T13:11:53.428 INFO:tasks.rados.rados.0.trial114.stdout:602: snap_create 2026-02-20T13:11:53.710 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:53.788 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:53.785+0000 7f52307ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:53.790 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:53.788+0000 7f52307ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:53.816 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:53.829 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:53.830 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:54.432 INFO:tasks.rados.rados.0.trial114.stdout:602: done (0 left) 2026-02-20T13:11:54.432 INFO:tasks.rados.rados.0.trial114.stdout:603: read oid 1 snap -1 2026-02-20T13:11:54.432 INFO:tasks.rados.rados.0.trial114.stdout:603: expect (ObjNum 250 snap 77 seq_num 250) 2026-02-20T13:11:54.433 INFO:tasks.rados.rados.0.trial114.stdout:604: write oid 34 current snap is 86 2026-02-20T13:11:54.433 INFO:tasks.rados.rados.0.trial114.stdout:604: seq_num 278 ranges {672346=707930,2134700=537646} 2026-02-20T13:11:54.437 INFO:tasks.rados.rados.0.trial114.stdout:604: writing trial11441570-34 from 672346 to 1380276 tid 1 2026-02-20T13:11:54.442 INFO:tasks.rados.rados.0.trial114.stdout:604: writing trial11441570-34 from 2134700 to 2672346 tid 2 2026-02-20T13:11:54.442 INFO:tasks.rados.rados.0.trial114.stdout:605: write (excl) oid 4 current snap is 86 2026-02-20T13:11:54.442 INFO:tasks.rados.rados.0.trial114.stdout:605: seq_num 279 ranges {689153=783179,2076829=457413} 2026-02-20T13:11:54.448 INFO:tasks.rados.rados.0.trial114.stdout:605: writing trial11441570-4 from 689153 to 1472332 tid 1 2026-02-20T13:11:54.452 INFO:tasks.rados.rados.0.trial114.stdout:605: writing trial11441570-4 from 2076829 to 2534242 tid 2 2026-02-20T13:11:54.452 INFO:tasks.rados.rados.0.trial114.stdout:606: read oid 2 snap -1 2026-02-20T13:11:54.452 INFO:tasks.rados.rados.0.trial114.stdout:606: expect deleted 2026-02-20T13:11:54.452 INFO:tasks.rados.rados.0.trial114.stdout:607: delete oid 28 current snap is 86 2026-02-20T13:11:54.473 INFO:tasks.rados.rados.0.trial114.stdout:603: expect (ObjNum 250 snap 77 seq_num 250) 2026-02-20T13:11:54.552 INFO:tasks.rados.rados.0.trial114.stdout:603: done (4 left) 2026-02-20T13:11:54.552 INFO:tasks.rados.rados.0.trial114.stdout:607: done (3 left) 2026-02-20T13:11:54.552 INFO:tasks.rados.rados.0.trial114.stdout:608: read oid 35 snap -1 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:608: expect deleted 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:609: write (excl) oid 37 current snap is 86 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:605: finishing write tid 1 to trial11441570-4 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:605: finishing write tid 2 to trial11441570-4 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:605: finishing write tid 3 to trial11441570-4 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:605: finishing write tid 4 to trial11441570-4 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:605: oid 4 updating version 0 to 38 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:605: oid 4 version 38 is already newer than 36 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:605: oid 4 version 38 is already newer than 38 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 4 v 38 (ObjNum 279 snap 86 seq_num 279) dirty exists 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:605: left oid 4 (ObjNum 279 snap 86 seq_num 279) 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:604: finishing write tid 1 to trial11441570-34 2026-02-20T13:11:54.553 INFO:tasks.rados.rados.0.trial114.stdout:604: finishing write tid 2 to trial11441570-34 2026-02-20T13:11:54.554 INFO:tasks.rados.rados.0.trial114.stdout:604: finishing write tid 3 to trial11441570-34 2026-02-20T13:11:54.554 INFO:tasks.rados.rados.0.trial114.stdout:609: seq_num 281 ranges {722767=533677,1793793=461082} 2026-02-20T13:11:54.557 INFO:tasks.rados.rados.0.trial114.stdout:609: writing trial11441570-37 from 722767 to 1256444 tid 1 2026-02-20T13:11:54.562 INFO:tasks.rados.rados.0.trial114.stdout:609: writing trial11441570-37 from 1793793 to 2254875 tid 2 2026-02-20T13:11:54.562 INFO:tasks.rados.rados.0.trial114.stdout:605: done (4 left) 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:606: done (3 left) 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:610: read oid 50 snap 84 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:610: expect (ObjNum 234 snap 74 seq_num 234) 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:611: read oid 28 snap 81 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:611: expect (ObjNum 152 snap 35 seq_num 152) 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:612: read oid 7 snap -1 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:612: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:613: read oid 44 snap -1 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:613: expect (ObjNum 238 snap 76 seq_num 238) 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:614: read oid 30 snap -1 2026-02-20T13:11:54.563 INFO:tasks.rados.rados.0.trial114.stdout:614: expect (ObjNum 195 snap 61 seq_num 195) 2026-02-20T13:11:54.564 INFO:tasks.rados.rados.0.trial114.stdout:615: delete oid 29 current snap is 86 2026-02-20T13:11:54.564 INFO:tasks.rados.rados.0.trial114.stdout:604: finishing write tid 4 to trial11441570-34 2026-02-20T13:11:54.564 INFO:tasks.rados.rados.0.trial114.stdout:604: oid 34 updating version 0 to 109 2026-02-20T13:11:54.564 INFO:tasks.rados.rados.0.trial114.stdout:604: oid 34 version 109 is already newer than 109 2026-02-20T13:11:54.564 INFO:tasks.rados.rados.0.trial114.stdout:604: oid 34 version 109 is already newer than 109 2026-02-20T13:11:54.564 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 34 v 109 (ObjNum 278 snap 86 seq_num 278) dirty exists 2026-02-20T13:11:54.564 INFO:tasks.rados.rados.0.trial114.stdout:604: left oid 34 (ObjNum 278 snap 86 seq_num 278) 2026-02-20T13:11:54.575 INFO:tasks.rados.rados.0.trial114.stdout:609: finishing write tid 1 to trial11441570-37 2026-02-20T13:11:54.593 INFO:tasks.rados.rados.0.trial114.stdout:610: expect (ObjNum 234 snap 74 seq_num 234) 2026-02-20T13:11:54.620 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:54.687 INFO:tasks.rados.rados.0.trial114.stdout:604: done (8 left) 2026-02-20T13:11:54.687 INFO:tasks.rados.rados.0.trial114.stdout:608: done (7 left) 2026-02-20T13:11:54.687 INFO:tasks.rados.rados.0.trial114.stdout:610: done (6 left) 2026-02-20T13:11:54.688 INFO:tasks.rados.rados.0.trial114.stdout:615: done (5 left) 2026-02-20T13:11:54.688 INFO:tasks.rados.rados.0.trial114.stdout:616: write oid 18 current snap is 86 2026-02-20T13:11:54.688 INFO:tasks.rados.rados.0.trial114.stdout:612: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:54.690 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 760682 2026-02-20T13:11:54.701 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:54.728 INFO:tasks.rados.rados.0.trial114.stdout:609: finishing write tid 2 to trial11441570-37 2026-02-20T13:11:54.728 INFO:tasks.rados.rados.0.trial114.stdout:614: expect (ObjNum 195 snap 61 seq_num 195) 2026-02-20T13:11:54.729 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 97729 2026-02-20T13:11:54.804 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2423717 2026-02-20T13:11:54.833 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1757608 2026-02-20T13:11:54.856 INFO:tasks.rados.rados.0.trial114.stdout:609: finishing write tid 3 to trial11441570-37 2026-02-20T13:11:54.856 INFO:tasks.rados.rados.0.trial114.stdout:609: finishing write tid 4 to trial11441570-37 2026-02-20T13:11:54.856 INFO:tasks.rados.rados.0.trial114.stdout:609: oid 37 updating version 0 to 237 2026-02-20T13:11:54.856 INFO:tasks.rados.rados.0.trial114.stdout:609: oid 37 version 237 is already newer than 235 2026-02-20T13:11:54.856 INFO:tasks.rados.rados.0.trial114.stdout:609: oid 37 version 237 is already newer than 237 2026-02-20T13:11:54.856 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 37 v 237 (ObjNum 281 snap 86 seq_num 281) dirty exists 2026-02-20T13:11:54.856 INFO:tasks.rados.rados.0.trial114.stdout:609: left oid 37 (ObjNum 281 snap 86 seq_num 281) 2026-02-20T13:11:54.856 INFO:tasks.rados.rados.0.trial114.stdout:613: expect (ObjNum 238 snap 76 seq_num 238) 2026-02-20T13:11:54.857 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 503858 2026-02-20T13:11:54.874 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:11:54.896 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 273772 2026-02-20T13:11:54.916 INFO:tasks.rados.rados.0.trial114.stdout:611: expect (ObjNum 152 snap 35 seq_num 152) 2026-02-20T13:11:54.984 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1775888 2026-02-20T13:11:54.995 INFO:tasks.rados.rados.0.trial114.stdout:616: seq_num 283 ranges {756381=400528,1910757=464751} 2026-02-20T13:11:55.000 INFO:tasks.rados.rados.0.trial114.stdout:616: writing trial11441570-18 from 756381 to 1156909 tid 1 2026-02-20T13:11:55.004 INFO:tasks.rados.rados.0.trial114.stdout:616: writing trial11441570-18 from 1910757 to 2375508 tid 2 2026-02-20T13:11:55.005 INFO:tasks.rados.rados.0.trial114.stdout:609: done (5 left) 2026-02-20T13:11:55.005 INFO:tasks.rados.rados.0.trial114.stdout:611: done (4 left) 2026-02-20T13:11:55.005 INFO:tasks.rados.rados.0.trial114.stdout:612: done (3 left) 2026-02-20T13:11:55.005 INFO:tasks.rados.rados.0.trial114.stdout:613: done (2 left) 2026-02-20T13:11:55.005 INFO:tasks.rados.rados.0.trial114.stdout:614: done (1 left) 2026-02-20T13:11:55.005 INFO:tasks.rados.rados.0.trial114.stdout:617: snap_remove snap 66 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:617: done (1 left) 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:618: delete oid 35 current snap is 86 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:616: finishing write tid 1 to trial11441570-18 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:616: finishing write tid 2 to trial11441570-18 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:616: finishing write tid 3 to trial11441570-18 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:616: finishing write tid 4 to trial11441570-18 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:616: oid 18 updating version 0 to 77 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:616: oid 18 version 77 is already newer than 77 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:616: oid 18 version 77 is already newer than 77 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 18 v 77 (ObjNum 283 snap 86 seq_num 283) dirty exists 2026-02-20T13:11:55.438 INFO:tasks.rados.rados.0.trial114.stdout:616: left oid 18 (ObjNum 283 snap 86 seq_num 283) 2026-02-20T13:11:55.455 INFO:tasks.rados.rados.0.trial114.stdout:616: done (1 left) 2026-02-20T13:11:55.455 INFO:tasks.rados.rados.0.trial114.stdout:618: done (0 left) 2026-02-20T13:11:55.455 INFO:tasks.rados.rados.0.trial114.stdout:619: snap_create 2026-02-20T13:11:55.830 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:11:55.903 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:11:55.907 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:55.902+0000 7f7180bad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:55.908 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:55.906+0000 7f7180bad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:55.935 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:55.951 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:55.951 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:55.975 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:11:55.977 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:11:55.978 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:11:56.442 INFO:tasks.rados.rados.0.trial114.stdout:619: done (0 left) 2026-02-20T13:11:56.442 INFO:tasks.rados.rados.0.trial114.stdout:620: write oid 49 current snap is 87 2026-02-20T13:11:56.442 INFO:tasks.rados.rados.0.trial114.stdout:620: seq_num 285 ranges {789995=551026,2027721=468420} 2026-02-20T13:11:56.447 INFO:tasks.rados.rados.0.trial114.stdout:620: writing trial11441570-49 from 789995 to 1341021 tid 1 2026-02-20T13:11:56.452 INFO:tasks.rados.rados.0.trial114.stdout:620: writing trial11441570-49 from 2027721 to 2496141 tid 2 2026-02-20T13:11:56.452 INFO:tasks.rados.rados.0.trial114.stdout:621: write oid 42 current snap is 87 2026-02-20T13:11:56.452 INFO:tasks.rados.rados.0.trial114.stdout:621: seq_num 286 ranges {406802=626275,1686203=728431} 2026-02-20T13:11:56.456 INFO:tasks.rados.rados.0.trial114.stdout:621: writing trial11441570-42 from 406802 to 1033077 tid 1 2026-02-20T13:11:56.461 INFO:tasks.rados.rados.0.trial114.stdout:621: writing trial11441570-42 from 1686203 to 2414634 tid 2 2026-02-20T13:11:56.461 INFO:tasks.rados.rados.0.trial114.stdout:622: snap_remove snap 76 2026-02-20T13:11:57.444 INFO:tasks.rados.rados.0.trial114.stdout:622: done (2 left) 2026-02-20T13:11:57.444 INFO:tasks.rados.rados.0.trial114.stdout:623: snap_create 2026-02-20T13:11:57.444 INFO:tasks.rados.rados.0.trial114.stdout:620: finishing write tid 1 to trial11441570-49 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:620: finishing write tid 2 to trial11441570-49 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:620: finishing write tid 3 to trial11441570-49 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:620: finishing write tid 4 to trial11441570-49 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:620: oid 49 updating version 0 to 17 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:620: oid 49 version 17 is already newer than 17 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:620: oid 49 version 17 is already newer than 17 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 49 v 17 (ObjNum 285 snap 87 seq_num 285) dirty exists 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:620: left oid 49 (ObjNum 285 snap 87 seq_num 285) 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:621: finishing write tid 1 to trial11441570-42 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:621: finishing write tid 2 to trial11441570-42 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:621: finishing write tid 3 to trial11441570-42 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:621: finishing write tid 4 to trial11441570-42 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:621: oid 42 updating version 0 to 50 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:621: oid 42 version 50 is already newer than 50 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:621: oid 42 version 50 is already newer than 50 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 42 v 50 (ObjNum 286 snap 87 seq_num 286) dirty exists 2026-02-20T13:11:57.445 INFO:tasks.rados.rados.0.trial114.stdout:621: left oid 42 (ObjNum 286 snap 87 seq_num 286) 2026-02-20T13:11:57.952 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:11:58.030 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:58.026+0000 7f7b15e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:58.032 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:11:58.030+0000 7f7b15e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:11:58.059 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:11:58.075 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:11:58.076 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:11:58.447 INFO:tasks.rados.rados.0.trial114.stdout:620: done (2 left) 2026-02-20T13:11:58.448 INFO:tasks.rados.rados.0.trial114.stdout:621: done (1 left) 2026-02-20T13:11:58.448 INFO:tasks.rados.rados.0.trial114.stdout:623: done (0 left) 2026-02-20T13:11:58.448 INFO:tasks.rados.rados.0.trial114.stdout:624: read oid 7 snap -1 2026-02-20T13:11:58.448 INFO:tasks.rados.rados.0.trial114.stdout:624: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:58.448 INFO:tasks.rados.rados.0.trial114.stdout:625: read oid 48 snap -1 2026-02-20T13:11:58.448 INFO:tasks.rados.rados.0.trial114.stdout:625: expect deleted 2026-02-20T13:11:58.448 INFO:tasks.rados.rados.0.trial114.stdout:626: snap_create 2026-02-20T13:11:58.479 INFO:tasks.rados.rados.0.trial114.stdout:624: expect (ObjNum 6 snap 0 seq_num 6) 2026-02-20T13:11:58.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~154s 2026-02-20T13:11:59.379 INFO:tasks.rados.rados.0.trial114.stdout:624: done (2 left) 2026-02-20T13:11:59.380 INFO:tasks.rados.rados.0.trial114.stdout:625: done (1 left) 2026-02-20T13:11:59.380 INFO:tasks.rados.rados.0.trial114.stdout:626: done (0 left) 2026-02-20T13:11:59.380 INFO:tasks.rados.rados.0.trial114.stdout:627: read oid 6 snap -1 2026-02-20T13:11:59.380 INFO:tasks.rados.rados.0.trial114.stdout:627: expect deleted 2026-02-20T13:11:59.380 INFO:tasks.rados.rados.0.trial114.stdout:628: snap_remove snap 84 2026-02-20T13:12:00.076 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:12:00.154 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:00.150+0000 7f896f2b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:00.157 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:00.153+0000 7f896f2b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:00.185 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:00.201 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:00.202 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:00.384 INFO:tasks.rados.rados.0.trial114.stdout:628: done (1 left) 2026-02-20T13:12:00.384 INFO:tasks.rados.rados.0.trial114.stdout:629: write oid 23 current snap is 89 2026-02-20T13:12:00.384 INFO:tasks.rados.rados.0.trial114.stdout:629: seq_num 287 ranges {423609=701524,1628332=472089,2648987=174622} 2026-02-20T13:12:00.388 INFO:tasks.rados.rados.0.trial114.stdout:629: writing trial11441570-23 from 423609 to 1125133 tid 1 2026-02-20T13:12:00.392 INFO:tasks.rados.rados.0.trial114.stdout:629: writing trial11441570-23 from 1628332 to 2100421 tid 2 2026-02-20T13:12:00.395 INFO:tasks.rados.rados.0.trial114.stdout:629: writing trial11441570-23 from 2648987 to 2823609 tid 3 2026-02-20T13:12:00.395 INFO:tasks.rados.rados.0.trial114.stdout:630: snap_create 2026-02-20T13:12:00.415 INFO:tasks.rados.rados.0.trial114.stdout:629: finishing write tid 1 to trial11441570-23 2026-02-20T13:12:00.422 INFO:tasks.rados.rados.0.trial114.stdout:629: finishing write tid 2 to trial11441570-23 2026-02-20T13:12:00.430 INFO:tasks.rados.rados.0.trial114.stdout:629: finishing write tid 3 to trial11441570-23 2026-02-20T13:12:00.435 INFO:tasks.rados.rados.0.trial114.stdout:629: finishing write tid 4 to trial11441570-23 2026-02-20T13:12:00.437 INFO:tasks.rados.rados.0.trial114.stdout:629: finishing write tid 5 to trial11441570-23 2026-02-20T13:12:00.437 INFO:tasks.rados.rados.0.trial114.stdout:629: oid 23 updating version 0 to 258 2026-02-20T13:12:00.437 INFO:tasks.rados.rados.0.trial114.stdout:629: oid 23 version 258 is already newer than 258 2026-02-20T13:12:00.437 INFO:tasks.rados.rados.0.trial114.stdout:629: oid 23 version 258 is already newer than 258 2026-02-20T13:12:00.437 INFO:tasks.rados.rados.0.trial114.stdout:629: oid 23 version 258 is already newer than 258 2026-02-20T13:12:00.437 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 23 v 258 (ObjNum 287 snap 89 seq_num 287) dirty exists 2026-02-20T13:12:00.438 INFO:tasks.rados.rados.0.trial114.stdout:629: left oid 23 (ObjNum 287 snap 89 seq_num 287) 2026-02-20T13:12:00.979 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:01.052 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:01.054 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:01.055 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:01.384 INFO:tasks.rados.rados.0.trial114.stdout:627: done (2 left) 2026-02-20T13:12:01.385 INFO:tasks.rados.rados.0.trial114.stdout:629: done (1 left) 2026-02-20T13:12:01.385 INFO:tasks.rados.rados.0.trial114.stdout:630: done (0 left) 2026-02-20T13:12:01.385 INFO:tasks.rados.rados.0.trial114.stdout:631: read oid 11 snap -1 2026-02-20T13:12:01.385 INFO:tasks.rados.rados.0.trial114.stdout:631: expect (ObjNum 176 snap 49 seq_num 176) 2026-02-20T13:12:01.385 INFO:tasks.rados.rados.0.trial114.stdout:632: read oid 24 snap 82 2026-02-20T13:12:01.385 INFO:tasks.rados.rados.0.trial114.stdout:632: expect (ObjNum 220 snap 70 seq_num 220) 2026-02-20T13:12:01.385 INFO:tasks.rados.rados.0.trial114.stdout:633: write oid 27 current snap is 90 2026-02-20T13:12:01.385 INFO:tasks.rados.rados.0.trial114.stdout:633: seq_num 288 ranges {440416=776773,1686814=732100} 2026-02-20T13:12:01.389 INFO:tasks.rados.rados.0.trial114.stdout:633: writing trial11441570-27 from 440416 to 1217189 tid 1 2026-02-20T13:12:01.394 INFO:tasks.rados.rados.0.trial114.stdout:633: writing trial11441570-27 from 1686814 to 2418914 tid 2 2026-02-20T13:12:01.394 INFO:tasks.rados.rados.0.trial114.stdout:634: write (excl) oid 36 current snap is 90 2026-02-20T13:12:01.394 INFO:tasks.rados.rados.0.trial114.stdout:634: seq_num 289 ranges {457223=568375,1461649=475758,2420186=437037} 2026-02-20T13:12:01.398 INFO:tasks.rados.rados.0.trial114.stdout:634: writing trial11441570-36 from 457223 to 1025598 tid 1 2026-02-20T13:12:01.402 INFO:tasks.rados.rados.0.trial114.stdout:634: writing trial11441570-36 from 1461649 to 1937407 tid 2 2026-02-20T13:12:01.405 INFO:tasks.rados.rados.0.trial114.stdout:634: writing trial11441570-36 from 2420186 to 2857223 tid 3 2026-02-20T13:12:01.405 INFO:tasks.rados.rados.0.trial114.stdout:635: write oid 6 current snap is 90 2026-02-20T13:12:01.406 INFO:tasks.rados.rados.0.trial114.stdout:635: seq_num 290 ranges {474030=643624,1520131=735769} 2026-02-20T13:12:01.409 INFO:tasks.rados.rados.0.trial114.stdout:635: writing trial11441570-6 from 474030 to 1117654 tid 1 2026-02-20T13:12:01.414 INFO:tasks.rados.rados.0.trial114.stdout:635: writing trial11441570-6 from 1520131 to 2255900 tid 2 2026-02-20T13:12:01.414 INFO:tasks.rados.rados.0.trial114.stdout:636: delete oid 38 current snap is 90 2026-02-20T13:12:01.421 INFO:tasks.rados.rados.0.trial114.stdout:631: expect (ObjNum 176 snap 49 seq_num 176) 2026-02-20T13:12:01.537 INFO:tasks.rados.rados.0.trial114.stdout:632: expect (ObjNum 220 snap 70 seq_num 220) 2026-02-20T13:12:01.537 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:01.701 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:01.784 INFO:tasks.rados.rados.0.trial114.stdout:633: finishing write tid 1 to trial11441570-27 2026-02-20T13:12:01.784 INFO:tasks.rados.rados.0.trial114.stdout:631: done (5 left) 2026-02-20T13:12:01.785 INFO:tasks.rados.rados.0.trial114.stdout:632: done (4 left) 2026-02-20T13:12:01.785 INFO:tasks.rados.rados.0.trial114.stdout:636: done (3 left) 2026-02-20T13:12:01.785 INFO:tasks.rados.rados.0.trial114.stdout:637: write oid 47 current snap is 90 2026-02-20T13:12:01.785 INFO:tasks.rados.rados.0.trial114.stdout:635: finishing write tid 1 to trial11441570-6 2026-02-20T13:12:01.785 INFO:tasks.rados.rados.0.trial114.stdout:637: seq_num 292 ranges {507644=794122,1920742=623085} 2026-02-20T13:12:01.789 INFO:tasks.rados.rados.0.trial114.stdout:637: writing trial11441570-47 from 507644 to 1301766 tid 1 2026-02-20T13:12:01.794 INFO:tasks.rados.rados.0.trial114.stdout:637: writing trial11441570-47 from 1920742 to 2543827 tid 2 2026-02-20T13:12:01.794 INFO:tasks.rados.rados.0.trial114.stdout:638: write (excl) oid 20 current snap is 90 2026-02-20T13:12:01.794 INFO:tasks.rados.rados.0.trial114.stdout:635: finishing write tid 2 to trial11441570-6 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:633: finishing write tid 2 to trial11441570-27 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:635: finishing write tid 3 to trial11441570-6 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:635: finishing write tid 4 to trial11441570-6 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:635: oid 6 updating version 0 to 130 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:635: oid 6 version 130 is already newer than 130 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:635: oid 6 version 130 is already newer than 130 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 6 v 130 (ObjNum 290 snap 90 seq_num 290) dirty exists 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:635: left oid 6 (ObjNum 290 snap 90 seq_num 290) 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:633: finishing write tid 3 to trial11441570-27 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:633: finishing write tid 4 to trial11441570-27 2026-02-20T13:12:01.795 INFO:tasks.rados.rados.0.trial114.stdout:633: oid 27 updating version 0 to 119 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:633: oid 27 version 119 is already newer than 119 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:633: oid 27 version 119 is already newer than 119 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 27 v 119 (ObjNum 288 snap 90 seq_num 288) dirty exists 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:633: left oid 27 (ObjNum 288 snap 90 seq_num 288) 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:634: finishing write tid 1 to trial11441570-36 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:634: finishing write tid 2 to trial11441570-36 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:634: finishing write tid 3 to trial11441570-36 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:634: finishing write tid 4 to trial11441570-36 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:634: finishing write tid 5 to trial11441570-36 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:634: oid 36 updating version 0 to 252 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:634: oid 36 version 252 is already newer than 252 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:634: oid 36 version 252 is already newer than 252 2026-02-20T13:12:01.796 INFO:tasks.rados.rados.0.trial114.stdout:634: oid 36 version 252 is already newer than 249 2026-02-20T13:12:01.797 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 36 v 252 (ObjNum 289 snap 90 seq_num 289) dirty exists 2026-02-20T13:12:01.797 INFO:tasks.rados.rados.0.trial114.stdout:634: left oid 36 (ObjNum 289 snap 90 seq_num 289) 2026-02-20T13:12:01.797 INFO:tasks.rados.rados.0.trial114.stdout:638: seq_num 293 ranges {524451=469371,1579224=483096,2529878=394573} 2026-02-20T13:12:01.798 INFO:tasks.rados.rados.0.trial114.stdout:638: writing trial11441570-20 from 524451 to 993822 tid 1 2026-02-20T13:12:01.802 INFO:tasks.rados.rados.0.trial114.stdout:638: writing trial11441570-20 from 1579224 to 2062320 tid 2 2026-02-20T13:12:01.806 INFO:tasks.rados.rados.0.trial114.stdout:638: writing trial11441570-20 from 2529878 to 2924451 tid 3 2026-02-20T13:12:01.806 INFO:tasks.rados.rados.0.trial114.stdout:633: done (4 left) 2026-02-20T13:12:01.806 INFO:tasks.rados.rados.0.trial114.stdout:634: done (3 left) 2026-02-20T13:12:01.806 INFO:tasks.rados.rados.0.trial114.stdout:635: done (2 left) 2026-02-20T13:12:01.806 INFO:tasks.rados.rados.0.trial114.stdout:639: read oid 25 snap -1 2026-02-20T13:12:01.806 INFO:tasks.rados.rados.0.trial114.stdout:639: expect (ObjNum 255 snap 79 seq_num 255) 2026-02-20T13:12:01.806 INFO:tasks.rados.rados.0.trial114.stdout:640: read oid 13 snap -1 2026-02-20T13:12:01.806 INFO:tasks.rados.rados.0.trial114.stdout:640: expect deleted 2026-02-20T13:12:01.806 INFO:tasks.rados.rados.0.trial114.stdout:641: snap_create 2026-02-20T13:12:01.826 INFO:tasks.rados.rados.0.trial114.stdout:637: finishing write tid 1 to trial11441570-47 2026-02-20T13:12:01.832 INFO:tasks.rados.rados.0.trial114.stdout:637: finishing write tid 2 to trial11441570-47 2026-02-20T13:12:01.835 INFO:tasks.rados.rados.0.trial114.stdout:637: finishing write tid 3 to trial11441570-47 2026-02-20T13:12:01.837 INFO:tasks.rados.rados.0.trial114.stdout:637: finishing write tid 4 to trial11441570-47 2026-02-20T13:12:01.837 INFO:tasks.rados.rados.0.trial114.stdout:637: oid 47 updating version 0 to 40 2026-02-20T13:12:01.837 INFO:tasks.rados.rados.0.trial114.stdout:637: oid 47 version 40 is already newer than 40 2026-02-20T13:12:01.837 INFO:tasks.rados.rados.0.trial114.stdout:637: oid 47 version 40 is already newer than 40 2026-02-20T13:12:01.837 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 47 v 40 (ObjNum 292 snap 90 seq_num 292) dirty exists 2026-02-20T13:12:01.837 INFO:tasks.rados.rados.0.trial114.stdout:637: left oid 47 (ObjNum 292 snap 90 seq_num 292) 2026-02-20T13:12:01.848 INFO:tasks.rados.rados.0.trial114.stdout:638: finishing write tid 1 to trial11441570-20 2026-02-20T13:12:01.854 INFO:tasks.rados.rados.0.trial114.stdout:639: expect (ObjNum 255 snap 79 seq_num 255) 2026-02-20T13:12:01.878 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1907117 2026-02-20T13:12:01.910 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 472575 2026-02-20T13:12:01.942 INFO:tasks.rados.rados.0.trial114.stdout:638: finishing write tid 2 to trial11441570-20 2026-02-20T13:12:01.942 INFO:tasks.rados.rados.0.trial114.stdout:638: finishing write tid 3 to trial11441570-20 2026-02-20T13:12:01.942 INFO:tasks.rados.rados.0.trial114.stdout:638: finishing write tid 4 to trial11441570-20 2026-02-20T13:12:01.942 INFO:tasks.rados.rados.0.trial114.stdout:638: finishing write tid 5 to trial11441570-20 2026-02-20T13:12:01.942 INFO:tasks.rados.rados.0.trial114.stdout:638: oid 20 updating version 0 to 78 2026-02-20T13:12:01.942 INFO:tasks.rados.rados.0.trial114.stdout:638: oid 20 version 78 is already newer than 78 2026-02-20T13:12:01.942 INFO:tasks.rados.rados.0.trial114.stdout:638: oid 20 version 78 is already newer than 75 2026-02-20T13:12:01.942 INFO:tasks.rados.rados.0.trial114.stdout:638: oid 20 version 78 is already newer than 78 2026-02-20T13:12:01.942 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 20 v 78 (ObjNum 293 snap 90 seq_num 293) dirty exists 2026-02-20T13:12:01.943 INFO:tasks.rados.rados.0.trial114.stdout:638: left oid 20 (ObjNum 293 snap 90 seq_num 293) 2026-02-20T13:12:02.203 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:12:02.280 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:02.275+0000 7f8d42a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:02.282 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:02.279+0000 7f8d42a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:02.309 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:02.325 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:02.326 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:02.387 INFO:tasks.rados.rados.0.trial114.stdout:637: done (4 left) 2026-02-20T13:12:02.387 INFO:tasks.rados.rados.0.trial114.stdout:638: done (3 left) 2026-02-20T13:12:02.387 INFO:tasks.rados.rados.0.trial114.stdout:639: done (2 left) 2026-02-20T13:12:02.387 INFO:tasks.rados.rados.0.trial114.stdout:640: done (1 left) 2026-02-20T13:12:02.387 INFO:tasks.rados.rados.0.trial114.stdout:641: done (0 left) 2026-02-20T13:12:02.387 INFO:tasks.rados.rados.0.trial114.stdout:642: write oid 13 current snap is 91 2026-02-20T13:12:02.388 INFO:tasks.rados.rados.0.trial114.stdout:642: seq_num 294 ranges {541258=544620,1637706=626754,2840948=100310} 2026-02-20T13:12:02.391 INFO:tasks.rados.rados.0.trial114.stdout:642: writing trial11441570-13 from 541258 to 1085878 tid 1 2026-02-20T13:12:02.395 INFO:tasks.rados.rados.0.trial114.stdout:642: writing trial11441570-13 from 1637706 to 2264460 tid 2 2026-02-20T13:12:02.398 INFO:tasks.rados.rados.0.trial114.stdout:642: writing trial11441570-13 from 2840948 to 2941258 tid 3 2026-02-20T13:12:02.398 INFO:tasks.rados.rados.0.trial114.stdout:643: write (excl) oid 46 current snap is 91 2026-02-20T13:12:02.398 INFO:tasks.rados.rados.0.trial114.stdout:643: seq_num 295 ranges {558065=619869,1579835=486765,2468371=489694} 2026-02-20T13:12:02.403 INFO:tasks.rados.rados.0.trial114.stdout:643: writing trial11441570-46 from 558065 to 1177934 tid 1 2026-02-20T13:12:02.406 INFO:tasks.rados.rados.0.trial114.stdout:643: writing trial11441570-46 from 1579835 to 2066600 tid 2 2026-02-20T13:12:02.409 INFO:tasks.rados.rados.0.trial114.stdout:643: writing trial11441570-46 from 2468371 to 2958065 tid 3 2026-02-20T13:12:02.410 INFO:tasks.rados.rados.0.trial114.stdout:644: delete oid 45 current snap is 91 2026-02-20T13:12:02.419 INFO:tasks.rados.rados.0.trial114.stdout:642: finishing write tid 1 to trial11441570-13 2026-02-20T13:12:02.430 INFO:tasks.rados.rados.0.trial114.stdout:642: finishing write tid 2 to trial11441570-13 2026-02-20T13:12:02.439 INFO:tasks.rados.rados.0.trial114.stdout:642: finishing write tid 3 to trial11441570-13 2026-02-20T13:12:02.439 INFO:tasks.rados.rados.0.trial114.stdout:643: finishing write tid 1 to trial11441570-46 2026-02-20T13:12:02.445 INFO:tasks.rados.rados.0.trial114.stdout:642: finishing write tid 4 to trial11441570-13 2026-02-20T13:12:02.448 INFO:tasks.rados.rados.0.trial114.stdout:642: finishing write tid 5 to trial11441570-13 2026-02-20T13:12:02.449 INFO:tasks.rados.rados.0.trial114.stdout:642: oid 13 updating version 0 to 155 2026-02-20T13:12:02.449 INFO:tasks.rados.rados.0.trial114.stdout:642: oid 13 version 155 is already newer than 155 2026-02-20T13:12:02.449 INFO:tasks.rados.rados.0.trial114.stdout:642: oid 13 version 155 is already newer than 155 2026-02-20T13:12:02.449 INFO:tasks.rados.rados.0.trial114.stdout:642: oid 13 version 155 is already newer than 155 2026-02-20T13:12:02.449 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 13 v 155 (ObjNum 294 snap 91 seq_num 294) dirty exists 2026-02-20T13:12:02.449 INFO:tasks.rados.rados.0.trial114.stdout:642: left oid 13 (ObjNum 294 snap 91 seq_num 294) 2026-02-20T13:12:02.455 INFO:tasks.rados.rados.0.trial114.stdout:643: finishing write tid 2 to trial11441570-46 2026-02-20T13:12:02.460 INFO:tasks.rados.rados.0.trial114.stdout:643: finishing write tid 3 to trial11441570-46 2026-02-20T13:12:02.463 INFO:tasks.rados.rados.0.trial114.stdout:642: done (2 left) 2026-02-20T13:12:02.463 INFO:tasks.rados.rados.0.trial114.stdout:644: done (1 left) 2026-02-20T13:12:02.463 INFO:tasks.rados.rados.0.trial114.stdout:645: read oid 8 snap -1 2026-02-20T13:12:02.464 INFO:tasks.rados.rados.0.trial114.stdout:645: expect deleted 2026-02-20T13:12:02.464 INFO:tasks.rados.rados.0.trial114.stdout:646: read oid 42 snap -1 2026-02-20T13:12:02.464 INFO:tasks.rados.rados.0.trial114.stdout:646: expect (ObjNum 286 snap 87 seq_num 286) 2026-02-20T13:12:02.464 INFO:tasks.rados.rados.0.trial114.stdout:647: write oid 34 current snap is 91 2026-02-20T13:12:02.464 INFO:tasks.rados.rados.0.trial114.stdout:647: seq_num 297 ranges {591679=486720,1813152=490434} 2026-02-20T13:12:02.467 INFO:tasks.rados.rados.0.trial114.stdout:647: writing trial11441570-34 from 591679 to 1078399 tid 1 2026-02-20T13:12:02.472 INFO:tasks.rados.rados.0.trial114.stdout:647: writing trial11441570-34 from 1813152 to 2303586 tid 2 2026-02-20T13:12:02.472 INFO:tasks.rados.rados.0.trial114.stdout:648: write (excl) oid 47 current snap is 91 2026-02-20T13:12:02.472 INFO:tasks.rados.rados.0.trial114.stdout:648: seq_num 298 ranges {608486=561969,1871634=634092,2950640=57846} 2026-02-20T13:12:02.476 INFO:tasks.rados.rados.0.trial114.stdout:648: writing trial11441570-47 from 608486 to 1170455 tid 1 2026-02-20T13:12:02.481 INFO:tasks.rados.rados.0.trial114.stdout:648: writing trial11441570-47 from 1871634 to 2505726 tid 2 2026-02-20T13:12:02.483 INFO:tasks.rados.rados.0.trial114.stdout:648: writing trial11441570-47 from 2950640 to 3008486 tid 3 2026-02-20T13:12:02.484 INFO:tasks.rados.rados.0.trial114.stdout:649: snap_remove snap 78 2026-02-20T13:12:03.390 INFO:tasks.rados.rados.0.trial114.stdout:649: done (5 left) 2026-02-20T13:12:03.390 INFO:tasks.rados.rados.0.trial114.stdout:650: snap_remove snap 90 2026-02-20T13:12:04.327 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:12:04.391 INFO:tasks.rados.rados.0.trial114.stdout:650: done (5 left) 2026-02-20T13:12:04.391 INFO:tasks.rados.rados.0.trial114.stdout:651: read oid 16 snap -1 2026-02-20T13:12:04.391 INFO:tasks.rados.rados.0.trial114.stdout:651: expect (ObjNum 254 snap 79 seq_num 254) 2026-02-20T13:12:04.391 INFO:tasks.rados.rados.0.trial114.stdout:643: finishing write tid 4 to trial11441570-46 2026-02-20T13:12:04.391 INFO:tasks.rados.rados.0.trial114.stdout:652: read oid 41 snap -1 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:652: expect (ObjNum 262 snap 80 seq_num 262) 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:653: snap_create 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:643: finishing write tid 5 to trial11441570-46 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:643: oid 46 updating version 0 to 126 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:643: oid 46 version 126 is already newer than 123 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:643: oid 46 version 126 is already newer than 126 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:643: oid 46 version 126 is already newer than 126 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 46 v 126 (ObjNum 295 snap 91 seq_num 295) dirty exists 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:643: left oid 46 (ObjNum 295 snap 91 seq_num 295) 2026-02-20T13:12:04.392 INFO:tasks.rados.rados.0.trial114.stdout:646: expect (ObjNum 286 snap 87 seq_num 286) 2026-02-20T13:12:04.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~160s 2026-02-20T13:12:04.406 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:04.402+0000 7fe2cad0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:04.408 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:04.405+0000 7fe2cad0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:04.434 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:04.447 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:04.450 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:04.451 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:04.484 INFO:tasks.rados.rados.0.trial114.stdout:647: finishing write tid 1 to trial11441570-34 2026-02-20T13:12:04.484 INFO:tasks.rados.rados.0.trial114.stdout:648: finishing write tid 1 to trial11441570-47 2026-02-20T13:12:04.484 INFO:tasks.rados.rados.0.trial114.stdout:647: finishing write tid 2 to trial11441570-34 2026-02-20T13:12:04.484 INFO:tasks.rados.rados.0.trial114.stdout:647: finishing write tid 3 to trial11441570-34 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:647: finishing write tid 4 to trial11441570-34 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:647: oid 34 updating version 0 to 113 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:647: oid 34 version 113 is already newer than 113 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:647: oid 34 version 113 is already newer than 113 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 34 v 113 (ObjNum 297 snap 91 seq_num 297) dirty exists 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:647: left oid 34 (ObjNum 297 snap 91 seq_num 297) 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:648: finishing write tid 2 to trial11441570-47 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:648: finishing write tid 3 to trial11441570-47 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:648: finishing write tid 4 to trial11441570-47 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:648: finishing write tid 5 to trial11441570-47 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:648: oid 47 updating version 0 to 45 2026-02-20T13:12:04.485 INFO:tasks.rados.rados.0.trial114.stdout:648: oid 47 version 45 is already newer than 42 2026-02-20T13:12:04.486 INFO:tasks.rados.rados.0.trial114.stdout:648: oid 47 version 45 is already newer than 45 2026-02-20T13:12:04.486 INFO:tasks.rados.rados.0.trial114.stdout:648: oid 47 version 45 is already newer than 45 2026-02-20T13:12:04.486 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 47 v 45 (ObjNum 298 snap 91 seq_num 298) dirty exists 2026-02-20T13:12:04.486 INFO:tasks.rados.rados.0.trial114.stdout:648: left oid 47 (ObjNum 298 snap 91 seq_num 298) 2026-02-20T13:12:04.486 INFO:tasks.rados.rados.0.trial114.stdout:652: expect (ObjNum 262 snap 80 seq_num 262) 2026-02-20T13:12:04.486 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 746351 2026-02-20T13:12:04.542 INFO:tasks.rados.rados.0.trial114.stdout:651: expect (ObjNum 254 snap 79 seq_num 254) 2026-02-20T13:12:05.395 INFO:tasks.rados.rados.0.trial114.stdout:643: done (7 left) 2026-02-20T13:12:05.395 INFO:tasks.rados.rados.0.trial114.stdout:645: done (6 left) 2026-02-20T13:12:05.395 INFO:tasks.rados.rados.0.trial114.stdout:646: done (5 left) 2026-02-20T13:12:05.396 INFO:tasks.rados.rados.0.trial114.stdout:647: done (4 left) 2026-02-20T13:12:05.396 INFO:tasks.rados.rados.0.trial114.stdout:648: done (3 left) 2026-02-20T13:12:05.396 INFO:tasks.rados.rados.0.trial114.stdout:651: done (2 left) 2026-02-20T13:12:05.396 INFO:tasks.rados.rados.0.trial114.stdout:652: done (1 left) 2026-02-20T13:12:05.396 INFO:tasks.rados.rados.0.trial114.stdout:653: done (0 left) 2026-02-20T13:12:05.396 INFO:tasks.rados.rados.0.trial114.stdout:654: write (excl) oid 22 current snap is 92 2026-02-20T13:12:05.396 INFO:tasks.rados.rados.0.trial114.stdout:654: seq_num 299 ranges {625293=637218,1813763=494103,2978063=47230} 2026-02-20T13:12:05.400 INFO:tasks.rados.rados.0.trial114.stdout:654: writing trial11441570-22 from 625293 to 1262511 tid 1 2026-02-20T13:12:05.404 INFO:tasks.rados.rados.0.trial114.stdout:654: writing trial11441570-22 from 1813763 to 2307866 tid 2 2026-02-20T13:12:05.406 INFO:tasks.rados.rados.0.trial114.stdout:654: writing trial11441570-22 from 2978063 to 3025293 tid 3 2026-02-20T13:12:05.406 INFO:tasks.rados.rados.0.trial114.stdout:655: delete oid 4 current snap is 92 2026-02-20T13:12:05.429 INFO:tasks.rados.rados.0.trial114.stdout:654: finishing write tid 1 to trial11441570-22 2026-02-20T13:12:05.445 INFO:tasks.rados.rados.0.trial114.stdout:654: finishing write tid 2 to trial11441570-22 2026-02-20T13:12:05.452 INFO:tasks.rados.rados.0.trial114.stdout:654: finishing write tid 3 to trial11441570-22 2026-02-20T13:12:05.464 INFO:tasks.rados.rados.0.trial114.stdout:654: finishing write tid 4 to trial11441570-22 2026-02-20T13:12:05.466 INFO:tasks.rados.rados.0.trial114.stdout:654: finishing write tid 5 to trial11441570-22 2026-02-20T13:12:05.466 INFO:tasks.rados.rados.0.trial114.stdout:654: oid 22 updating version 0 to 163 2026-02-20T13:12:05.466 INFO:tasks.rados.rados.0.trial114.stdout:654: oid 22 version 163 is already newer than 163 2026-02-20T13:12:05.466 INFO:tasks.rados.rados.0.trial114.stdout:654: oid 22 version 163 is already newer than 163 2026-02-20T13:12:05.466 INFO:tasks.rados.rados.0.trial114.stdout:654: oid 22 version 163 is already newer than 160 2026-02-20T13:12:05.466 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 22 v 163 (ObjNum 299 snap 92 seq_num 299) dirty exists 2026-02-20T13:12:05.466 INFO:tasks.rados.rados.0.trial114.stdout:654: left oid 22 (ObjNum 299 snap 92 seq_num 299) 2026-02-20T13:12:05.479 INFO:tasks.rados.rados.0.trial114.stdout:654: done (1 left) 2026-02-20T13:12:05.479 INFO:tasks.rados.rados.0.trial114.stdout:655: done (0 left) 2026-02-20T13:12:05.479 INFO:tasks.rados.rados.0.trial114.stdout:656: read oid 33 snap 91 2026-02-20T13:12:05.479 INFO:tasks.rados.rados.0.trial114.stdout:656: expect deleted 2026-02-20T13:12:05.479 INFO:tasks.rados.rados.0.trial114.stdout:657: write oid 40 current snap is 92 2026-02-20T13:12:05.479 INFO:tasks.rados.rados.0.trial114.stdout:657: seq_num 301 ranges {658907=787716,1930727=497772,3032909=25998} 2026-02-20T13:12:05.484 INFO:tasks.rados.rados.0.trial114.stdout:657: writing trial11441570-40 from 658907 to 1446623 tid 1 2026-02-20T13:12:05.488 INFO:tasks.rados.rados.0.trial114.stdout:657: writing trial11441570-40 from 1930727 to 2428499 tid 2 2026-02-20T13:12:05.490 INFO:tasks.rados.rados.0.trial114.stdout:657: writing trial11441570-40 from 3032909 to 3058907 tid 3 2026-02-20T13:12:05.490 INFO:tasks.rados.rados.0.trial114.stdout:658: delete oid 27 current snap is 92 2026-02-20T13:12:05.522 INFO:tasks.rados.rados.0.trial114.stdout:657: finishing write tid 1 to trial11441570-40 2026-02-20T13:12:05.528 INFO:tasks.rados.rados.0.trial114.stdout:657: finishing write tid 2 to trial11441570-40 2026-02-20T13:12:05.533 INFO:tasks.rados.rados.0.trial114.stdout:657: finishing write tid 3 to trial11441570-40 2026-02-20T13:12:05.539 INFO:tasks.rados.rados.0.trial114.stdout:657: finishing write tid 4 to trial11441570-40 2026-02-20T13:12:05.541 INFO:tasks.rados.rados.0.trial114.stdout:657: finishing write tid 5 to trial11441570-40 2026-02-20T13:12:05.541 INFO:tasks.rados.rados.0.trial114.stdout:657: oid 40 updating version 0 to 131 2026-02-20T13:12:05.541 INFO:tasks.rados.rados.0.trial114.stdout:657: oid 40 version 131 is already newer than 131 2026-02-20T13:12:05.541 INFO:tasks.rados.rados.0.trial114.stdout:657: oid 40 version 131 is already newer than 131 2026-02-20T13:12:05.541 INFO:tasks.rados.rados.0.trial114.stdout:657: oid 40 version 131 is already newer than 131 2026-02-20T13:12:05.541 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 40 v 131 (ObjNum 301 snap 92 seq_num 301) dirty exists 2026-02-20T13:12:05.541 INFO:tasks.rados.rados.0.trial114.stdout:657: left oid 40 (ObjNum 301 snap 92 seq_num 301) 2026-02-20T13:12:05.553 INFO:tasks.rados.rados.0.trial114.stdout:656: done (2 left) 2026-02-20T13:12:05.553 INFO:tasks.rados.rados.0.trial114.stdout:657: done (1 left) 2026-02-20T13:12:05.553 INFO:tasks.rados.rados.0.trial114.stdout:658: done (0 left) 2026-02-20T13:12:05.553 INFO:tasks.rados.rados.0.trial114.stdout:659: delete oid 1 current snap is 92 2026-02-20T13:12:05.581 INFO:tasks.rados.rados.0.trial114.stdout:659: done (0 left) 2026-02-20T13:12:05.581 INFO:tasks.rados.rados.0.trial114.stdout:660: write (excl) oid 30 current snap is 92 2026-02-20T13:12:05.581 INFO:tasks.rados.rados.0.trial114.stdout:660: seq_num 304 ranges {709328=613463,1989820=645099} 2026-02-20T13:12:05.585 INFO:tasks.rados.rados.0.trial114.stdout:660: writing trial11441570-30 from 709328 to 1322791 tid 1 2026-02-20T13:12:05.591 INFO:tasks.rados.rados.0.trial114.stdout:660: writing trial11441570-30 from 1989820 to 2634919 tid 2 2026-02-20T13:12:05.591 INFO:tasks.rados.rados.0.trial114.stdout:661: write (excl) oid 8 current snap is 92 2026-02-20T13:12:05.591 INFO:tasks.rados.rados.0.trial114.stdout:661: seq_num 305 ranges {726135=405065,1764655=788757,3026248=99887} 2026-02-20T13:12:05.595 INFO:tasks.rados.rados.0.trial114.stdout:661: writing trial11441570-8 from 726135 to 1131200 tid 1 2026-02-20T13:12:05.601 INFO:tasks.rados.rados.0.trial114.stdout:661: writing trial11441570-8 from 1764655 to 2553412 tid 2 2026-02-20T13:12:05.603 INFO:tasks.rados.rados.0.trial114.stdout:661: writing trial11441570-8 from 3026248 to 3126135 tid 3 2026-02-20T13:12:05.603 INFO:tasks.rados.rados.0.trial114.stdout:662: snap_create 2026-02-20T13:12:05.611 INFO:tasks.rados.rados.0.trial114.stdout:661: finishing write tid 1 to trial11441570-8 2026-02-20T13:12:05.630 INFO:tasks.rados.rados.0.trial114.stdout:661: finishing write tid 2 to trial11441570-8 2026-02-20T13:12:05.631 INFO:tasks.rados.rados.0.trial114.stdout:660: finishing write tid 1 to trial11441570-30 2026-02-20T13:12:05.634 INFO:tasks.rados.rados.0.trial114.stdout:661: finishing write tid 3 to trial11441570-8 2026-02-20T13:12:05.639 INFO:tasks.rados.rados.0.trial114.stdout:661: finishing write tid 4 to trial11441570-8 2026-02-20T13:12:05.640 INFO:tasks.rados.rados.0.trial114.stdout:661: finishing write tid 5 to trial11441570-8 2026-02-20T13:12:05.640 INFO:tasks.rados.rados.0.trial114.stdout:661: oid 8 updating version 0 to 31 2026-02-20T13:12:05.640 INFO:tasks.rados.rados.0.trial114.stdout:661: oid 8 version 31 is already newer than 28 2026-02-20T13:12:05.641 INFO:tasks.rados.rados.0.trial114.stdout:661: oid 8 version 31 is already newer than 31 2026-02-20T13:12:05.641 INFO:tasks.rados.rados.0.trial114.stdout:661: oid 8 version 31 is already newer than 31 2026-02-20T13:12:05.641 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 8 v 31 (ObjNum 305 snap 92 seq_num 305) dirty exists 2026-02-20T13:12:05.641 INFO:tasks.rados.rados.0.trial114.stdout:661: left oid 8 (ObjNum 305 snap 92 seq_num 305) 2026-02-20T13:12:05.646 INFO:tasks.rados.rados.0.trial114.stdout:660: finishing write tid 2 to trial11441570-30 2026-02-20T13:12:05.651 INFO:tasks.rados.rados.0.trial114.stdout:660: finishing write tid 3 to trial11441570-30 2026-02-20T13:12:05.652 INFO:tasks.rados.rados.0.trial114.stdout:660: finishing write tid 4 to trial11441570-30 2026-02-20T13:12:05.652 INFO:tasks.rados.rados.0.trial114.stdout:660: oid 30 updating version 0 to 270 2026-02-20T13:12:05.652 INFO:tasks.rados.rados.0.trial114.stdout:660: oid 30 version 270 is already newer than 268 2026-02-20T13:12:05.652 INFO:tasks.rados.rados.0.trial114.stdout:660: oid 30 version 270 is already newer than 270 2026-02-20T13:12:05.653 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 30 v 270 (ObjNum 304 snap 92 seq_num 304) dirty exists 2026-02-20T13:12:05.653 INFO:tasks.rados.rados.0.trial114.stdout:660: left oid 30 (ObjNum 304 snap 92 seq_num 304) 2026-02-20T13:12:06.056 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:06.126 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:06.129 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:06.130 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:06.401 INFO:tasks.rados.rados.0.trial114.stdout:660: done (2 left) 2026-02-20T13:12:06.401 INFO:tasks.rados.rados.0.trial114.stdout:661: done (1 left) 2026-02-20T13:12:06.401 INFO:tasks.rados.rados.0.trial114.stdout:662: done (0 left) 2026-02-20T13:12:06.401 INFO:tasks.rados.rados.0.trial114.stdout:663: read oid 48 snap -1 2026-02-20T13:12:06.401 INFO:tasks.rados.rados.0.trial114.stdout:663: expect deleted 2026-02-20T13:12:06.401 INFO:tasks.rados.rados.0.trial114.stdout:664: delete oid 34 current snap is 93 2026-02-20T13:12:06.447 INFO:tasks.rados.rados.0.trial114.stdout:663: done (1 left) 2026-02-20T13:12:06.447 INFO:tasks.rados.rados.0.trial114.stdout:664: done (0 left) 2026-02-20T13:12:06.447 INFO:tasks.rados.rados.0.trial114.stdout:665: write (excl) oid 8 current snap is 93 2026-02-20T13:12:06.447 INFO:tasks.rados.rados.0.trial114.stdout:665: seq_num 307 ranges {759749=555563,1765266=792426,2964741=195008} 2026-02-20T13:12:06.451 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:12:06.452 INFO:tasks.rados.rados.0.trial114.stdout:665: writing trial11441570-8 from 759749 to 1315312 tid 1 2026-02-20T13:12:06.456 INFO:tasks.rados.rados.0.trial114.stdout:665: writing trial11441570-8 from 1765266 to 2557692 tid 2 2026-02-20T13:12:06.459 INFO:tasks.rados.rados.0.trial114.stdout:665: writing trial11441570-8 from 2964741 to 3159749 tid 3 2026-02-20T13:12:06.459 INFO:tasks.rados.rados.0.trial114.stdout:666: write (excl) oid 26 current snap is 93 2026-02-20T13:12:06.459 INFO:tasks.rados.rados.0.trial114.stdout:666: seq_num 308 ranges {776556=630812,1823748=652437,3108517=68039} 2026-02-20T13:12:06.464 INFO:tasks.rados.rados.0.trial114.stdout:666: writing trial11441570-26 from 776556 to 1407368 tid 1 2026-02-20T13:12:06.468 INFO:tasks.rados.rados.0.trial114.stdout:666: writing trial11441570-26 from 1823748 to 2476185 tid 2 2026-02-20T13:12:06.471 INFO:tasks.rados.rados.0.trial114.stdout:666: writing trial11441570-26 from 3108517 to 3176556 tid 3 2026-02-20T13:12:06.471 INFO:tasks.rados.rados.0.trial114.stdout:667: delete oid 29 current snap is 93 2026-02-20T13:12:06.474 INFO:tasks.rados.rados.0.trial114.stdout:667: done (2 left) 2026-02-20T13:12:06.475 INFO:tasks.rados.rados.0.trial114.stdout:668: delete oid 16 current snap is 93 2026-02-20T13:12:06.478 INFO:tasks.rados.rados.0.trial114.stdout:665: finishing write tid 1 to trial11441570-8 2026-02-20T13:12:06.490 INFO:tasks.rados.rados.0.trial114.stdout:666: finishing write tid 1 to trial11441570-26 2026-02-20T13:12:06.501 INFO:tasks.rados.rados.0.trial114.stdout:665: finishing write tid 2 to trial11441570-8 2026-02-20T13:12:06.518 INFO:tasks.rados.rados.0.trial114.stdout:665: finishing write tid 3 to trial11441570-8 2026-02-20T13:12:06.526 INFO:tasks.rados.rados.0.trial114.stdout:665: finishing write tid 4 to trial11441570-8 2026-02-20T13:12:06.528 INFO:tasks.rados.rados.0.trial114.stdout:665: finishing write tid 5 to trial11441570-8 2026-02-20T13:12:06.528 INFO:tasks.rados.rados.0.trial114.stdout:665: oid 8 updating version 0 to 36 2026-02-20T13:12:06.528 INFO:tasks.rados.rados.0.trial114.stdout:665: oid 8 version 36 is already newer than 33 2026-02-20T13:12:06.528 INFO:tasks.rados.rados.0.trial114.stdout:665: oid 8 version 36 is already newer than 36 2026-02-20T13:12:06.528 INFO:tasks.rados.rados.0.trial114.stdout:665: oid 8 version 36 is already newer than 36 2026-02-20T13:12:06.529 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 8 v 36 (ObjNum 307 snap 93 seq_num 307) dirty exists 2026-02-20T13:12:06.529 INFO:tasks.rados.rados.0.trial114.stdout:665: left oid 8 (ObjNum 307 snap 93 seq_num 307) 2026-02-20T13:12:06.531 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:06.527+0000 7f651bb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:06.534 INFO:tasks.rados.rados.0.trial114.stdout:666: finishing write tid 2 to trial11441570-26 2026-02-20T13:12:06.535 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:06.531+0000 7f651bb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:06.543 INFO:tasks.rados.rados.0.trial114.stdout:666: finishing write tid 3 to trial11441570-26 2026-02-20T13:12:06.548 INFO:tasks.rados.rados.0.trial114.stdout:666: finishing write tid 4 to trial11441570-26 2026-02-20T13:12:06.550 INFO:tasks.rados.rados.0.trial114.stdout:666: finishing write tid 5 to trial11441570-26 2026-02-20T13:12:06.550 INFO:tasks.rados.rados.0.trial114.stdout:666: oid 26 updating version 0 to 78 2026-02-20T13:12:06.550 INFO:tasks.rados.rados.0.trial114.stdout:666: oid 26 updating version 78 to 81 2026-02-20T13:12:06.550 INFO:tasks.rados.rados.0.trial114.stdout:666: oid 26 version 81 is already newer than 81 2026-02-20T13:12:06.550 INFO:tasks.rados.rados.0.trial114.stdout:666: oid 26 version 81 is already newer than 81 2026-02-20T13:12:06.550 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 26 v 81 (ObjNum 308 snap 93 seq_num 308) dirty exists 2026-02-20T13:12:06.550 INFO:tasks.rados.rados.0.trial114.stdout:666: left oid 26 (ObjNum 308 snap 93 seq_num 308) 2026-02-20T13:12:06.564 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:06.565 INFO:tasks.rados.rados.0.trial114.stdout:665: done (2 left) 2026-02-20T13:12:06.565 INFO:tasks.rados.rados.0.trial114.stdout:666: done (1 left) 2026-02-20T13:12:06.565 INFO:tasks.rados.rados.0.trial114.stdout:668: done (0 left) 2026-02-20T13:12:06.565 INFO:tasks.rados.rados.0.trial114.stdout:669: snap_create 2026-02-20T13:12:06.579 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:06.580 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:07.405 INFO:tasks.rados.rados.0.trial114.stdout:669: done (0 left) 2026-02-20T13:12:07.406 INFO:tasks.rados.rados.0.trial114.stdout:670: read oid 42 snap -1 2026-02-20T13:12:07.406 INFO:tasks.rados.rados.0.trial114.stdout:670: expect (ObjNum 286 snap 87 seq_num 286) 2026-02-20T13:12:07.406 INFO:tasks.rados.rados.0.trial114.stdout:671: write oid 28 current snap is 94 2026-02-20T13:12:07.406 INFO:tasks.rados.rados.0.trial114.stdout:671: seq_num 311 ranges {426977=456559,1482841=799764,2958080=268897} 2026-02-20T13:12:07.409 INFO:tasks.rados.rados.0.trial114.stdout:671: writing trial11441570-28 from 426977 to 883536 tid 1 2026-02-20T13:12:07.414 INFO:tasks.rados.rados.0.trial114.stdout:671: writing trial11441570-28 from 1482841 to 2282605 tid 2 2026-02-20T13:12:07.418 INFO:tasks.rados.rados.0.trial114.stdout:671: writing trial11441570-28 from 2958080 to 3226977 tid 3 2026-02-20T13:12:07.418 INFO:tasks.rados.rados.0.trial114.stdout:672: snap_remove snap 80 2026-02-20T13:12:08.408 INFO:tasks.rados.rados.0.trial114.stdout:672: done (2 left) 2026-02-20T13:12:08.408 INFO:tasks.rados.rados.0.trial114.stdout:673: write (excl) oid 29 current snap is 94 2026-02-20T13:12:08.408 INFO:tasks.rados.rados.0.trial114.stdout:673: seq_num 312 ranges {443784=648161,1657676=659775,2818209=425575} 2026-02-20T13:12:08.412 INFO:tasks.rados.rados.0.trial114.stdout:673: writing trial11441570-29 from 443784 to 1091945 tid 1 2026-02-20T13:12:08.417 INFO:tasks.rados.rados.0.trial114.stdout:673: writing trial11441570-29 from 1657676 to 2317451 tid 2 2026-02-20T13:12:08.421 INFO:tasks.rados.rados.0.trial114.stdout:673: writing trial11441570-29 from 2818209 to 3243784 tid 3 2026-02-20T13:12:08.421 INFO:tasks.rados.rados.0.trial114.stdout:674: snap_create 2026-02-20T13:12:08.421 INFO:tasks.rados.rados.0.trial114.stdout:670: expect (ObjNum 286 snap 87 seq_num 286) 2026-02-20T13:12:08.488 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:08.525 INFO:tasks.rados.rados.0.trial114.stdout:671: finishing write tid 1 to trial11441570-28 2026-02-20T13:12:08.525 INFO:tasks.rados.rados.0.trial114.stdout:671: finishing write tid 2 to trial11441570-28 2026-02-20T13:12:08.525 INFO:tasks.rados.rados.0.trial114.stdout:671: finishing write tid 3 to trial11441570-28 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:671: finishing write tid 4 to trial11441570-28 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:671: finishing write tid 5 to trial11441570-28 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:671: oid 28 updating version 0 to 137 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:671: oid 28 version 137 is already newer than 137 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:671: oid 28 version 137 is already newer than 137 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:671: oid 28 version 137 is already newer than 137 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 28 v 137 (ObjNum 311 snap 94 seq_num 311) dirty exists 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:671: left oid 28 (ObjNum 311 snap 94 seq_num 311) 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:673: finishing write tid 1 to trial11441570-29 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:673: finishing write tid 2 to trial11441570-29 2026-02-20T13:12:08.526 INFO:tasks.rados.rados.0.trial114.stdout:673: finishing write tid 3 to trial11441570-29 2026-02-20T13:12:08.527 INFO:tasks.rados.rados.0.trial114.stdout:673: finishing write tid 4 to trial11441570-29 2026-02-20T13:12:08.527 INFO:tasks.rados.rados.0.trial114.stdout:673: finishing write tid 5 to trial11441570-29 2026-02-20T13:12:08.527 INFO:tasks.rados.rados.0.trial114.stdout:673: oid 29 updating version 0 to 134 2026-02-20T13:12:08.527 INFO:tasks.rados.rados.0.trial114.stdout:673: oid 29 version 134 is already newer than 134 2026-02-20T13:12:08.527 INFO:tasks.rados.rados.0.trial114.stdout:673: oid 29 version 134 is already newer than 131 2026-02-20T13:12:08.527 INFO:tasks.rados.rados.0.trial114.stdout:673: oid 29 version 134 is already newer than 134 2026-02-20T13:12:08.527 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 29 v 134 (ObjNum 312 snap 94 seq_num 312) dirty exists 2026-02-20T13:12:08.527 INFO:tasks.rados.rados.0.trial114.stdout:673: left oid 29 (ObjNum 312 snap 94 seq_num 312) 2026-02-20T13:12:08.581 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:12:08.659 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:08.654+0000 7fa39a36f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:08.661 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:08.657+0000 7fa39a36f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:08.687 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:08.704 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:08.704 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:09.386 INFO:tasks.rados.rados.0.trial114.stdout:670: done (3 left) 2026-02-20T13:12:09.386 INFO:tasks.rados.rados.0.trial114.stdout:671: done (2 left) 2026-02-20T13:12:09.386 INFO:tasks.rados.rados.0.trial114.stdout:673: done (1 left) 2026-02-20T13:12:09.386 INFO:tasks.rados.rados.0.trial114.stdout:674: done (0 left) 2026-02-20T13:12:09.386 INFO:tasks.rados.rados.0.trial114.stdout:675: snap_remove snap 92 2026-02-20T13:12:09.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2026-02-20T13:12:10.391 INFO:tasks.rados.rados.0.trial114.stdout:675: done (0 left) 2026-02-20T13:12:10.392 INFO:tasks.rados.rados.0.trial114.stdout:676: read oid 12 snap -1 2026-02-20T13:12:10.392 INFO:tasks.rados.rados.0.trial114.stdout:676: expect (ObjNum 272 snap 83 seq_num 272) 2026-02-20T13:12:10.392 INFO:tasks.rados.rados.0.trial114.stdout:677: delete oid 35 current snap is 95 2026-02-20T13:12:10.406 INFO:tasks.rados.rados.0.trial114.stdout:677: done (1 left) 2026-02-20T13:12:10.407 INFO:tasks.rados.rados.0.trial114.stdout:678: read oid 39 snap -1 2026-02-20T13:12:10.407 INFO:tasks.rados.rados.0.trial114.stdout:678: expect deleted 2026-02-20T13:12:10.407 INFO:tasks.rados.rados.0.trial114.stdout:679: write oid 34 current snap is 95 2026-02-20T13:12:10.407 INFO:tasks.rados.rados.0.trial114.stdout:679: seq_num 314 ranges {477398=798659,1774640=663444,2873055=404343} 2026-02-20T13:12:10.411 INFO:tasks.rados.rados.0.trial114.stdout:679: writing trial11441570-34 from 477398 to 1276057 tid 1 2026-02-20T13:12:10.416 INFO:tasks.rados.rados.0.trial114.stdout:679: writing trial11441570-34 from 1774640 to 2438084 tid 2 2026-02-20T13:12:10.420 INFO:tasks.rados.rados.0.trial114.stdout:679: writing trial11441570-34 from 2873055 to 3277398 tid 3 2026-02-20T13:12:10.420 INFO:tasks.rados.rados.0.trial114.stdout:680: read oid 4 snap -1 2026-02-20T13:12:10.420 INFO:tasks.rados.rados.0.trial114.stdout:680: expect deleted 2026-02-20T13:12:10.420 INFO:tasks.rados.rados.0.trial114.stdout:681: snap_remove snap 68 2026-02-20T13:12:10.705 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:12:10.783 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:10.778+0000 7f20be17b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:10.785 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:10.781+0000 7f20be17b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:10.812 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:10.827 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:10.828 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:11.130 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:11.201 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:11.204 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:11.205 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:11.410 INFO:tasks.rados.rados.0.trial114.stdout:681: done (4 left) 2026-02-20T13:12:11.410 INFO:tasks.rados.rados.0.trial114.stdout:682: snap_remove snap 89 2026-02-20T13:12:12.413 INFO:tasks.rados.rados.0.trial114.stdout:682: done (4 left) 2026-02-20T13:12:12.413 INFO:tasks.rados.rados.0.trial114.stdout:683: write oid 18 current snap is 95 2026-02-20T13:12:12.413 INFO:tasks.rados.rados.0.trial114.stdout:683: seq_num 315 ranges {494205=473908,1433122=407102,2384125=462684} 2026-02-20T13:12:12.416 INFO:tasks.rados.rados.0.trial114.stdout:683: writing trial11441570-18 from 494205 to 968113 tid 1 2026-02-20T13:12:12.420 INFO:tasks.rados.rados.0.trial114.stdout:683: writing trial11441570-18 from 1433122 to 1840224 tid 2 2026-02-20T13:12:12.424 INFO:tasks.rados.rados.0.trial114.stdout:683: writing trial11441570-18 from 2384125 to 2846809 tid 3 2026-02-20T13:12:12.424 INFO:tasks.rados.rados.0.trial114.stdout:684: snap_remove snap 86 2026-02-20T13:12:12.828 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:12:12.906 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:12.901+0000 7f8eb3e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:12.908 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:12.904+0000 7f8eb3e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:12.938 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:12.953 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:12.954 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:13.418 INFO:tasks.rados.rados.0.trial114.stdout:684: done (5 left) 2026-02-20T13:12:13.418 INFO:tasks.rados.rados.0.trial114.stdout:685: snap_create 2026-02-20T13:12:13.418 INFO:tasks.rados.rados.0.trial114.stdout:676: expect (ObjNum 272 snap 83 seq_num 272) 2026-02-20T13:12:13.489 INFO:tasks.rados.rados.0.trial114.stdout:679: finishing write tid 1 to trial11441570-34 2026-02-20T13:12:13.489 INFO:tasks.rados.rados.0.trial114.stdout:679: finishing write tid 2 to trial11441570-34 2026-02-20T13:12:13.489 INFO:tasks.rados.rados.0.trial114.stdout:679: finishing write tid 3 to trial11441570-34 2026-02-20T13:12:13.489 INFO:tasks.rados.rados.0.trial114.stdout:679: finishing write tid 4 to trial11441570-34 2026-02-20T13:12:13.489 INFO:tasks.rados.rados.0.trial114.stdout:679: finishing write tid 5 to trial11441570-34 2026-02-20T13:12:13.489 INFO:tasks.rados.rados.0.trial114.stdout:679: oid 34 updating version 0 to 119 2026-02-20T13:12:13.489 INFO:tasks.rados.rados.0.trial114.stdout:679: oid 34 version 119 is already newer than 119 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:679: oid 34 version 119 is already newer than 119 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:679: oid 34 version 119 is already newer than 119 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 34 v 119 (ObjNum 314 snap 95 seq_num 314) dirty exists 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:679: left oid 34 (ObjNum 314 snap 95 seq_num 314) 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:683: finishing write tid 1 to trial11441570-18 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:683: finishing write tid 2 to trial11441570-18 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:683: finishing write tid 3 to trial11441570-18 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:683: finishing write tid 4 to trial11441570-18 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:683: finishing write tid 5 to trial11441570-18 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:683: oid 18 updating version 0 to 86 2026-02-20T13:12:13.490 INFO:tasks.rados.rados.0.trial114.stdout:683: oid 18 version 86 is already newer than 86 2026-02-20T13:12:13.491 INFO:tasks.rados.rados.0.trial114.stdout:683: oid 18 version 86 is already newer than 86 2026-02-20T13:12:13.491 INFO:tasks.rados.rados.0.trial114.stdout:683: oid 18 version 86 is already newer than 86 2026-02-20T13:12:13.491 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 18 v 86 (ObjNum 315 snap 95 seq_num 315) dirty exists 2026-02-20T13:12:13.491 INFO:tasks.rados.rados.0.trial114.stdout:683: left oid 18 (ObjNum 315 snap 95 seq_num 315) 2026-02-20T13:12:14.421 INFO:tasks.rados.rados.0.trial114.stdout:676: done (5 left) 2026-02-20T13:12:14.421 INFO:tasks.rados.rados.0.trial114.stdout:678: done (4 left) 2026-02-20T13:12:14.421 INFO:tasks.rados.rados.0.trial114.stdout:679: done (3 left) 2026-02-20T13:12:14.421 INFO:tasks.rados.rados.0.trial114.stdout:680: done (2 left) 2026-02-20T13:12:14.421 INFO:tasks.rados.rados.0.trial114.stdout:683: done (1 left) 2026-02-20T13:12:14.421 INFO:tasks.rados.rados.0.trial114.stdout:685: done (0 left) 2026-02-20T13:12:14.421 INFO:tasks.rados.rados.0.trial114.stdout:686: read oid 44 snap 87 2026-02-20T13:12:14.421 INFO:tasks.rados.rados.0.trial114.stdout:686: expect (ObjNum 238 snap 76 seq_num 238) 2026-02-20T13:12:14.421 INFO:tasks.rados.rados.0.trial114.stdout:687: write oid 47 current snap is 96 2026-02-20T13:12:14.422 INFO:tasks.rados.rados.0.trial114.stdout:687: seq_num 316 ranges {511012=549157,1775251=550760,3095195=215817} 2026-02-20T13:12:14.424 INFO:tasks.rados.rados.0.trial114.stdout:687: writing trial11441570-47 from 511012 to 1060169 tid 1 2026-02-20T13:12:14.430 INFO:tasks.rados.rados.0.trial114.stdout:687: writing trial11441570-47 from 1775251 to 2326011 tid 2 2026-02-20T13:12:14.434 INFO:tasks.rados.rados.0.trial114.stdout:687: writing trial11441570-47 from 3095195 to 3311012 tid 3 2026-02-20T13:12:14.434 INFO:tasks.rados.rados.0.trial114.stdout:688: write (excl) oid 8 current snap is 96 2026-02-20T13:12:14.434 INFO:tasks.rados.rados.0.trial114.stdout:688: seq_num 317 ranges {527819=624406,1833733=410771,2722618=601581} 2026-02-20T13:12:14.438 INFO:tasks.rados.rados.0.trial114.stdout:688: writing trial11441570-8 from 527819 to 1152225 tid 1 2026-02-20T13:12:14.442 INFO:tasks.rados.rados.0.trial114.stdout:688: writing trial11441570-8 from 1833733 to 2244504 tid 2 2026-02-20T13:12:14.446 INFO:tasks.rados.rados.0.trial114.stdout:688: writing trial11441570-8 from 2722618 to 3324199 tid 3 2026-02-20T13:12:14.446 INFO:tasks.rados.rados.0.trial114.stdout:689: delete oid 24 current snap is 96 2026-02-20T13:12:14.450 INFO:tasks.rados.rados.0.trial114.stdout:686: expect (ObjNum 238 snap 76 seq_num 238) 2026-02-20T13:12:14.462 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1916990 2026-02-20T13:12:14.462 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 84384 2026-02-20T13:12:14.489 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1659963 2026-02-20T13:12:14.497 INFO:tasks.rados.rados.0.trial114.stdout:686: done (3 left) 2026-02-20T13:12:14.497 INFO:tasks.rados.rados.0.trial114.stdout:689: done (2 left) 2026-02-20T13:12:14.497 INFO:tasks.rados.rados.0.trial114.stdout:690: snap_create 2026-02-20T13:12:14.497 INFO:tasks.rados.rados.0.trial114.stdout:687: finishing write tid 1 to trial11441570-47 2026-02-20T13:12:14.497 INFO:tasks.rados.rados.0.trial114.stdout:687: finishing write tid 2 to trial11441570-47 2026-02-20T13:12:14.497 INFO:tasks.rados.rados.0.trial114.stdout:687: finishing write tid 3 to trial11441570-47 2026-02-20T13:12:14.501 INFO:tasks.rados.rados.0.trial114.stdout:687: finishing write tid 4 to trial11441570-47 2026-02-20T13:12:14.504 INFO:tasks.rados.rados.0.trial114.stdout:687: finishing write tid 5 to trial11441570-47 2026-02-20T13:12:14.504 INFO:tasks.rados.rados.0.trial114.stdout:687: oid 47 updating version 0 to 50 2026-02-20T13:12:14.504 INFO:tasks.rados.rados.0.trial114.stdout:687: oid 47 version 50 is already newer than 50 2026-02-20T13:12:14.504 INFO:tasks.rados.rados.0.trial114.stdout:687: oid 47 version 50 is already newer than 50 2026-02-20T13:12:14.505 INFO:tasks.rados.rados.0.trial114.stdout:687: oid 47 version 50 is already newer than 50 2026-02-20T13:12:14.505 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 47 v 50 (ObjNum 316 snap 96 seq_num 316) dirty exists 2026-02-20T13:12:14.505 INFO:tasks.rados.rados.0.trial114.stdout:687: left oid 47 (ObjNum 316 snap 96 seq_num 316) 2026-02-20T13:12:14.545 INFO:tasks.rados.rados.0.trial114.stdout:688: finishing write tid 1 to trial11441570-8 2026-02-20T13:12:14.558 INFO:tasks.rados.rados.0.trial114.stdout:688: finishing write tid 2 to trial11441570-8 2026-02-20T13:12:14.573 INFO:tasks.rados.rados.0.trial114.stdout:688: finishing write tid 3 to trial11441570-8 2026-02-20T13:12:14.582 INFO:tasks.rados.rados.0.trial114.stdout:688: finishing write tid 4 to trial11441570-8 2026-02-20T13:12:14.585 INFO:tasks.rados.rados.0.trial114.stdout:688: finishing write tid 5 to trial11441570-8 2026-02-20T13:12:14.585 INFO:tasks.rados.rados.0.trial114.stdout:688: oid 8 updating version 0 to 41 2026-02-20T13:12:14.585 INFO:tasks.rados.rados.0.trial114.stdout:688: oid 8 version 41 is already newer than 41 2026-02-20T13:12:14.585 INFO:tasks.rados.rados.0.trial114.stdout:688: oid 8 version 41 is already newer than 41 2026-02-20T13:12:14.585 INFO:tasks.rados.rados.0.trial114.stdout:688: oid 8 version 41 is already newer than 38 2026-02-20T13:12:14.585 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 8 v 41 (ObjNum 317 snap 96 seq_num 317) dirty exists 2026-02-20T13:12:14.585 INFO:tasks.rados.rados.0.trial114.stdout:688: left oid 8 (ObjNum 317 snap 96 seq_num 317) 2026-02-20T13:12:14.954 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:12:15.033 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:15.029+0000 7f3c10c3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:15.035 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:15.033+0000 7f3c10c3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:15.062 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:15.078 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:15.079 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:15.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~171s 2026-02-20T13:12:15.426 INFO:tasks.rados.rados.0.trial114.stdout:687: done (2 left) 2026-02-20T13:12:15.426 INFO:tasks.rados.rados.0.trial114.stdout:688: done (1 left) 2026-02-20T13:12:15.426 INFO:tasks.rados.rados.0.trial114.stdout:690: done (0 left) 2026-02-20T13:12:15.426 INFO:tasks.rados.rados.0.trial114.stdout:691: snap_create 2026-02-20T13:12:16.205 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:16.275 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:16.278 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:16.278 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:16.430 INFO:tasks.rados.rados.0.trial114.stdout:691: done (0 left) 2026-02-20T13:12:16.430 INFO:tasks.rados.rados.0.trial114.stdout:692: write (excl) oid 44 current snap is 98 2026-02-20T13:12:16.430 INFO:tasks.rados.rados.0.trial114.stdout:692: seq_num 319 ranges {561433=774904,1950697=414440,2777464=583969} 2026-02-20T13:12:16.435 INFO:tasks.rados.rados.0.trial114.stdout:692: writing trial11441570-44 from 561433 to 1336337 tid 1 2026-02-20T13:12:16.439 INFO:tasks.rados.rados.0.trial114.stdout:692: writing trial11441570-44 from 1950697 to 2365137 tid 2 2026-02-20T13:12:16.443 INFO:tasks.rados.rados.0.trial114.stdout:692: writing trial11441570-44 from 2777464 to 3361433 tid 3 2026-02-20T13:12:16.443 INFO:tasks.rados.rados.0.trial114.stdout:693: delete oid 38 current snap is 98 2026-02-20T13:12:16.448 INFO:tasks.rados.rados.0.trial114.stdout:693: done (1 left) 2026-02-20T13:12:16.448 INFO:tasks.rados.rados.0.trial114.stdout:694: write (excl) oid 13 current snap is 98 2026-02-20T13:12:16.448 INFO:tasks.rados.rados.0.trial114.stdout:694: seq_num 321 ranges {595047=641755,1667661=418109,2548663=763022} 2026-02-20T13:12:16.453 INFO:tasks.rados.rados.0.trial114.stdout:694: writing trial11441570-13 from 595047 to 1236802 tid 1 2026-02-20T13:12:16.456 INFO:tasks.rados.rados.0.trial114.stdout:694: writing trial11441570-13 from 1667661 to 2085770 tid 2 2026-02-20T13:12:16.461 INFO:tasks.rados.rados.0.trial114.stdout:694: writing trial11441570-13 from 2548663 to 3311685 tid 3 2026-02-20T13:12:16.461 INFO:tasks.rados.rados.0.trial114.stdout:695: delete oid 17 current snap is 98 2026-02-20T13:12:16.485 INFO:tasks.rados.rados.0.trial114.stdout:694: finishing write tid 1 to trial11441570-13 2026-02-20T13:12:16.488 INFO:tasks.rados.rados.0.trial114.stdout:692: finishing write tid 1 to trial11441570-44 2026-02-20T13:12:16.505 INFO:tasks.rados.rados.0.trial114.stdout:694: finishing write tid 2 to trial11441570-13 2026-02-20T13:12:16.513 INFO:tasks.rados.rados.0.trial114.stdout:694: finishing write tid 3 to trial11441570-13 2026-02-20T13:12:16.513 INFO:tasks.rados.rados.0.trial114.stdout:692: finishing write tid 2 to trial11441570-44 2026-02-20T13:12:16.514 INFO:tasks.rados.rados.0.trial114.stdout:694: finishing write tid 4 to trial11441570-13 2026-02-20T13:12:16.516 INFO:tasks.rados.rados.0.trial114.stdout:694: finishing write tid 5 to trial11441570-13 2026-02-20T13:12:16.516 INFO:tasks.rados.rados.0.trial114.stdout:694: oid 13 updating version 0 to 172 2026-02-20T13:12:16.517 INFO:tasks.rados.rados.0.trial114.stdout:694: oid 13 version 172 is already newer than 169 2026-02-20T13:12:16.517 INFO:tasks.rados.rados.0.trial114.stdout:694: oid 13 version 172 is already newer than 172 2026-02-20T13:12:16.517 INFO:tasks.rados.rados.0.trial114.stdout:694: oid 13 version 172 is already newer than 172 2026-02-20T13:12:16.517 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 13 v 172 (ObjNum 321 snap 98 seq_num 321) dirty exists 2026-02-20T13:12:16.517 INFO:tasks.rados.rados.0.trial114.stdout:694: left oid 13 (ObjNum 321 snap 98 seq_num 321) 2026-02-20T13:12:16.522 INFO:tasks.rados.rados.0.trial114.stdout:692: finishing write tid 3 to trial11441570-44 2026-02-20T13:12:16.527 INFO:tasks.rados.rados.0.trial114.stdout:692: finishing write tid 4 to trial11441570-44 2026-02-20T13:12:16.530 INFO:tasks.rados.rados.0.trial114.stdout:692: finishing write tid 5 to trial11441570-44 2026-02-20T13:12:16.530 INFO:tasks.rados.rados.0.trial114.stdout:692: oid 44 updating version 0 to 282 2026-02-20T13:12:16.530 INFO:tasks.rados.rados.0.trial114.stdout:692: oid 44 updating version 282 to 285 2026-02-20T13:12:16.530 INFO:tasks.rados.rados.0.trial114.stdout:692: oid 44 version 285 is already newer than 285 2026-02-20T13:12:16.531 INFO:tasks.rados.rados.0.trial114.stdout:692: oid 44 version 285 is already newer than 285 2026-02-20T13:12:16.531 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 285 (ObjNum 319 snap 98 seq_num 319) dirty exists 2026-02-20T13:12:16.531 INFO:tasks.rados.rados.0.trial114.stdout:692: left oid 44 (ObjNum 319 snap 98 seq_num 319) 2026-02-20T13:12:16.544 INFO:tasks.rados.rados.0.trial114.stdout:692: done (2 left) 2026-02-20T13:12:16.544 INFO:tasks.rados.rados.0.trial114.stdout:694: done (1 left) 2026-02-20T13:12:16.544 INFO:tasks.rados.rados.0.trial114.stdout:695: done (0 left) 2026-02-20T13:12:16.544 INFO:tasks.rados.rados.0.trial114.stdout:696: write oid 44 current snap is 98 2026-02-20T13:12:16.544 INFO:tasks.rados.rados.0.trial114.stdout:696: seq_num 323 ranges {628661=792253,2184625=421778,3403509=25152} 2026-02-20T13:12:16.549 INFO:tasks.rados.rados.0.trial114.stdout:696: writing trial11441570-44 from 628661 to 1420914 tid 1 2026-02-20T13:12:16.554 INFO:tasks.rados.rados.0.trial114.stdout:696: writing trial11441570-44 from 2184625 to 2606403 tid 2 2026-02-20T13:12:16.558 INFO:tasks.rados.rados.0.trial114.stdout:696: writing trial11441570-44 from 3403509 to 3428661 tid 3 2026-02-20T13:12:16.558 INFO:tasks.rados.rados.0.trial114.stdout:697: read oid 11 snap -1 2026-02-20T13:12:16.558 INFO:tasks.rados.rados.0.trial114.stdout:697: expect (ObjNum 176 snap 49 seq_num 176) 2026-02-20T13:12:16.558 INFO:tasks.rados.rados.0.trial114.stdout:698: write oid 48 current snap is 98 2026-02-20T13:12:16.558 INFO:tasks.rados.rados.0.trial114.stdout:698: seq_num 324 ranges {645468=467502,1726754=565436,2798226=596838} 2026-02-20T13:12:16.561 INFO:tasks.rados.rados.0.trial114.stdout:698: writing trial11441570-48 from 645468 to 1112970 tid 1 2026-02-20T13:12:16.566 INFO:tasks.rados.rados.0.trial114.stdout:698: writing trial11441570-48 from 1726754 to 2292190 tid 2 2026-02-20T13:12:16.571 INFO:tasks.rados.rados.0.trial114.stdout:698: writing trial11441570-48 from 2798226 to 3395064 tid 3 2026-02-20T13:12:16.571 INFO:tasks.rados.rados.0.trial114.stdout:699: write (excl) oid 31 current snap is 98 2026-02-20T13:12:16.571 INFO:tasks.rados.rados.0.trial114.stdout:699: seq_num 325 ranges {662275=542751,1785236=425447,2942002=520273} 2026-02-20T13:12:16.575 INFO:tasks.rados.rados.0.trial114.stdout:699: writing trial11441570-31 from 662275 to 1205026 tid 1 2026-02-20T13:12:16.579 INFO:tasks.rados.rados.0.trial114.stdout:699: writing trial11441570-31 from 1785236 to 2210683 tid 2 2026-02-20T13:12:16.584 INFO:tasks.rados.rados.0.trial114.stdout:699: writing trial11441570-31 from 2942002 to 3462275 tid 3 2026-02-20T13:12:16.584 INFO:tasks.rados.rados.0.trial114.stdout:700: snap_create 2026-02-20T13:12:16.584 INFO:tasks.rados.rados.0.trial114.stdout:696: finishing write tid 1 to trial11441570-44 2026-02-20T13:12:16.584 INFO:tasks.rados.rados.0.trial114.stdout:696: finishing write tid 2 to trial11441570-44 2026-02-20T13:12:16.584 INFO:tasks.rados.rados.0.trial114.stdout:698: finishing write tid 1 to trial11441570-48 2026-02-20T13:12:16.590 INFO:tasks.rados.rados.0.trial114.stdout:696: finishing write tid 3 to trial11441570-44 2026-02-20T13:12:16.591 INFO:tasks.rados.rados.0.trial114.stdout:698: finishing write tid 2 to trial11441570-48 2026-02-20T13:12:16.591 INFO:tasks.rados.rados.0.trial114.stdout:696: finishing write tid 4 to trial11441570-44 2026-02-20T13:12:16.593 INFO:tasks.rados.rados.0.trial114.stdout:696: finishing write tid 5 to trial11441570-44 2026-02-20T13:12:16.593 INFO:tasks.rados.rados.0.trial114.stdout:696: oid 44 updating version 0 to 289 2026-02-20T13:12:16.593 INFO:tasks.rados.rados.0.trial114.stdout:696: oid 44 version 289 is already newer than 289 2026-02-20T13:12:16.593 INFO:tasks.rados.rados.0.trial114.stdout:696: oid 44 version 289 is already newer than 289 2026-02-20T13:12:16.593 INFO:tasks.rados.rados.0.trial114.stdout:696: oid 44 version 289 is already newer than 289 2026-02-20T13:12:16.593 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 289 (ObjNum 323 snap 98 seq_num 323) dirty exists 2026-02-20T13:12:16.594 INFO:tasks.rados.rados.0.trial114.stdout:696: left oid 44 (ObjNum 323 snap 98 seq_num 323) 2026-02-20T13:12:16.595 INFO:tasks.rados.rados.0.trial114.stdout:698: finishing write tid 3 to trial11441570-48 2026-02-20T13:12:16.599 INFO:tasks.rados.rados.0.trial114.stdout:698: finishing write tid 4 to trial11441570-48 2026-02-20T13:12:16.601 INFO:tasks.rados.rados.0.trial114.stdout:698: finishing write tid 5 to trial11441570-48 2026-02-20T13:12:16.601 INFO:tasks.rados.rados.0.trial114.stdout:698: oid 48 updating version 0 to 90 2026-02-20T13:12:16.601 INFO:tasks.rados.rados.0.trial114.stdout:698: oid 48 version 90 is already newer than 90 2026-02-20T13:12:16.601 INFO:tasks.rados.rados.0.trial114.stdout:698: oid 48 version 90 is already newer than 90 2026-02-20T13:12:16.601 INFO:tasks.rados.rados.0.trial114.stdout:698: oid 48 version 90 is already newer than 90 2026-02-20T13:12:16.601 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 48 v 90 (ObjNum 324 snap 98 seq_num 324) dirty exists 2026-02-20T13:12:16.602 INFO:tasks.rados.rados.0.trial114.stdout:698: left oid 48 (ObjNum 324 snap 98 seq_num 324) 2026-02-20T13:12:16.602 INFO:tasks.rados.rados.0.trial114.stdout:699: finishing write tid 1 to trial11441570-31 2026-02-20T13:12:16.602 INFO:tasks.rados.rados.0.trial114.stdout:697: expect (ObjNum 176 snap 49 seq_num 176) 2026-02-20T13:12:16.660 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2774313 2026-02-20T13:12:16.705 INFO:tasks.rados.rados.0.trial114.stdout:699: finishing write tid 2 to trial11441570-31 2026-02-20T13:12:16.705 INFO:tasks.rados.rados.0.trial114.stdout:699: finishing write tid 3 to trial11441570-31 2026-02-20T13:12:16.705 INFO:tasks.rados.rados.0.trial114.stdout:699: finishing write tid 4 to trial11441570-31 2026-02-20T13:12:16.705 INFO:tasks.rados.rados.0.trial114.stdout:699: finishing write tid 5 to trial11441570-31 2026-02-20T13:12:16.705 INFO:tasks.rados.rados.0.trial114.stdout:699: oid 31 updating version 0 to 120 2026-02-20T13:12:16.705 INFO:tasks.rados.rados.0.trial114.stdout:699: oid 31 updating version 120 to 123 2026-02-20T13:12:16.705 INFO:tasks.rados.rados.0.trial114.stdout:699: oid 31 version 123 is already newer than 123 2026-02-20T13:12:16.706 INFO:tasks.rados.rados.0.trial114.stdout:699: oid 31 version 123 is already newer than 123 2026-02-20T13:12:16.706 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 31 v 123 (ObjNum 325 snap 98 seq_num 325) dirty exists 2026-02-20T13:12:16.706 INFO:tasks.rados.rados.0.trial114.stdout:699: left oid 31 (ObjNum 325 snap 98 seq_num 325) 2026-02-20T13:12:17.080 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:12:17.160 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:17.156+0000 7f1560bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:17.162 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:17.160+0000 7f1560bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:17.189 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:17.205 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:17.206 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:17.435 INFO:tasks.rados.rados.0.trial114.stdout:696: done (4 left) 2026-02-20T13:12:17.435 INFO:tasks.rados.rados.0.trial114.stdout:697: done (3 left) 2026-02-20T13:12:17.435 INFO:tasks.rados.rados.0.trial114.stdout:698: done (2 left) 2026-02-20T13:12:17.435 INFO:tasks.rados.rados.0.trial114.stdout:699: done (1 left) 2026-02-20T13:12:17.436 INFO:tasks.rados.rados.0.trial114.stdout:700: done (0 left) 2026-02-20T13:12:17.436 INFO:tasks.rados.rados.0.trial114.stdout:701: snap_create 2026-02-20T13:12:18.435 INFO:tasks.rados.rados.0.trial114.stdout:701: done (0 left) 2026-02-20T13:12:18.435 INFO:tasks.rados.rados.0.trial114.stdout:702: write (excl) oid 2 current snap is 100 2026-02-20T13:12:18.435 INFO:tasks.rados.rados.0.trial114.stdout:702: seq_num 326 ranges {679082=618000,1843718=569105,2853072=626010} 2026-02-20T13:12:18.440 INFO:tasks.rados.rados.0.trial114.stdout:702: writing trial11441570-2 from 679082 to 1297082 tid 1 2026-02-20T13:12:18.444 INFO:tasks.rados.rados.0.trial114.stdout:702: writing trial11441570-2 from 1843718 to 2412823 tid 2 2026-02-20T13:12:18.449 INFO:tasks.rados.rados.0.trial114.stdout:702: writing trial11441570-2 from 2853072 to 3479082 tid 3 2026-02-20T13:12:18.449 INFO:tasks.rados.rados.0.trial114.stdout:703: snap_create 2026-02-20T13:12:18.462 INFO:tasks.rados.rados.0.trial114.stdout:702: finishing write tid 1 to trial11441570-2 2026-02-20T13:12:18.473 INFO:tasks.rados.rados.0.trial114.stdout:702: finishing write tid 2 to trial11441570-2 2026-02-20T13:12:18.480 INFO:tasks.rados.rados.0.trial114.stdout:702: finishing write tid 3 to trial11441570-2 2026-02-20T13:12:18.482 INFO:tasks.rados.rados.0.trial114.stdout:702: finishing write tid 4 to trial11441570-2 2026-02-20T13:12:18.483 INFO:tasks.rados.rados.0.trial114.stdout:702: finishing write tid 5 to trial11441570-2 2026-02-20T13:12:18.483 INFO:tasks.rados.rados.0.trial114.stdout:702: oid 2 updating version 0 to 45 2026-02-20T13:12:18.484 INFO:tasks.rados.rados.0.trial114.stdout:702: oid 2 version 45 is already newer than 45 2026-02-20T13:12:18.484 INFO:tasks.rados.rados.0.trial114.stdout:702: oid 2 version 45 is already newer than 42 2026-02-20T13:12:18.484 INFO:tasks.rados.rados.0.trial114.stdout:702: oid 2 version 45 is already newer than 45 2026-02-20T13:12:18.484 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 2 v 45 (ObjNum 326 snap 100 seq_num 326) dirty exists 2026-02-20T13:12:18.484 INFO:tasks.rados.rados.0.trial114.stdout:702: left oid 2 (ObjNum 326 snap 100 seq_num 326) 2026-02-20T13:12:19.207 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:12:19.283 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:19.280+0000 7f3c6390b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:19.286 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:19.284+0000 7f3c6390b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:19.314 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:19.330 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:19.331 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:19.383 INFO:tasks.rados.rados.0.trial114.stdout:702: done (1 left) 2026-02-20T13:12:19.384 INFO:tasks.rados.rados.0.trial114.stdout:703: done (0 left) 2026-02-20T13:12:19.384 INFO:tasks.rados.rados.0.trial114.stdout:704: read oid 26 snap 93 2026-02-20T13:12:19.384 INFO:tasks.rados.rados.0.trial114.stdout:704: expect (ObjNum 308 snap 93 seq_num 308) 2026-02-20T13:12:19.384 INFO:tasks.rados.rados.0.trial114.stdout:705: snap_remove snap 97 2026-02-20T13:12:20.388 INFO:tasks.rados.rados.0.trial114.stdout:705: done (1 left) 2026-02-20T13:12:20.389 INFO:tasks.rados.rados.0.trial114.stdout:706: read oid 8 snap -1 2026-02-20T13:12:20.389 INFO:tasks.rados.rados.0.trial114.stdout:706: expect (ObjNum 317 snap 96 seq_num 317) 2026-02-20T13:12:20.389 INFO:tasks.rados.rados.0.trial114.stdout:707: read oid 2 snap -1 2026-02-20T13:12:20.389 INFO:tasks.rados.rados.0.trial114.stdout:707: expect (ObjNum 326 snap 100 seq_num 326) 2026-02-20T13:12:20.389 INFO:tasks.rados.rados.0.trial114.stdout:708: read oid 13 snap -1 2026-02-20T13:12:20.389 INFO:tasks.rados.rados.0.trial114.stdout:708: expect (ObjNum 321 snap 98 seq_num 321) 2026-02-20T13:12:20.389 INFO:tasks.rados.rados.0.trial114.stdout:709: write oid 38 current snap is 101 2026-02-20T13:12:20.389 INFO:tasks.rados.rados.0.trial114.stdout:709: seq_num 327 ranges {695889=409602,1618553=712763,2996848=499041} 2026-02-20T13:12:20.392 INFO:tasks.rados.rados.0.trial114.stdout:709: writing trial11441570-38 from 695889 to 1105491 tid 1 2026-02-20T13:12:20.397 INFO:tasks.rados.rados.0.trial114.stdout:709: writing trial11441570-38 from 1618553 to 2331316 tid 2 2026-02-20T13:12:20.402 INFO:tasks.rados.rados.0.trial114.stdout:709: writing trial11441570-38 from 2996848 to 3495889 tid 3 2026-02-20T13:12:20.403 INFO:tasks.rados.rados.0.trial114.stdout:710: read oid 36 snap -1 2026-02-20T13:12:20.403 INFO:tasks.rados.rados.0.trial114.stdout:710: expect (ObjNum 289 snap 90 seq_num 289) 2026-02-20T13:12:20.403 INFO:tasks.rados.rados.0.trial114.stdout:711: delete oid 23 current snap is 101 2026-02-20T13:12:20.403 INFO:tasks.rados.rados.0.trial114.stdout:704: expect (ObjNum 308 snap 93 seq_num 308) 2026-02-20T13:12:20.406 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1178071 2026-02-20T13:12:20.464 INFO:tasks.rados.rados.0.trial114.stdout:709: finishing write tid 1 to trial11441570-38 2026-02-20T13:12:20.464 INFO:tasks.rados.rados.0.trial114.stdout:709: finishing write tid 2 to trial11441570-38 2026-02-20T13:12:20.464 INFO:tasks.rados.rados.0.trial114.stdout:709: finishing write tid 3 to trial11441570-38 2026-02-20T13:12:20.469 INFO:tasks.rados.rados.0.trial114.stdout:706: expect (ObjNum 317 snap 96 seq_num 317) 2026-02-20T13:12:20.603 INFO:tasks.rados.rados.0.trial114.stdout:709: finishing write tid 4 to trial11441570-38 2026-02-20T13:12:20.603 INFO:tasks.rados.rados.0.trial114.stdout:709: finishing write tid 5 to trial11441570-38 2026-02-20T13:12:20.603 INFO:tasks.rados.rados.0.trial114.stdout:709: oid 38 updating version 0 to 141 2026-02-20T13:12:20.603 INFO:tasks.rados.rados.0.trial114.stdout:709: oid 38 version 141 is already newer than 141 2026-02-20T13:12:20.603 INFO:tasks.rados.rados.0.trial114.stdout:709: oid 38 version 141 is already newer than 141 2026-02-20T13:12:20.603 INFO:tasks.rados.rados.0.trial114.stdout:709: oid 38 version 141 is already newer than 141 2026-02-20T13:12:20.603 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 38 v 141 (ObjNum 327 snap 101 seq_num 327) dirty exists 2026-02-20T13:12:20.604 INFO:tasks.rados.rados.0.trial114.stdout:709: left oid 38 (ObjNum 327 snap 101 seq_num 327) 2026-02-20T13:12:20.604 INFO:tasks.rados.rados.0.trial114.stdout:707: expect (ObjNum 326 snap 100 seq_num 326) 2026-02-20T13:12:20.604 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:20.659 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1598712 2026-02-20T13:12:20.678 INFO:tasks.rados.rados.0.trial114.stdout:710: expect (ObjNum 289 snap 90 seq_num 289) 2026-02-20T13:12:20.678 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:20.741 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 310289 2026-02-20T13:12:20.771 INFO:tasks.rados.rados.0.trial114.stdout:708: expect (ObjNum 321 snap 98 seq_num 321) 2026-02-20T13:12:20.789 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2618834 2026-02-20T13:12:20.839 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:20.880 INFO:tasks.rados.rados.0.trial114.stdout:704: done (6 left) 2026-02-20T13:12:20.880 INFO:tasks.rados.rados.0.trial114.stdout:706: done (5 left) 2026-02-20T13:12:20.880 INFO:tasks.rados.rados.0.trial114.stdout:707: done (4 left) 2026-02-20T13:12:20.881 INFO:tasks.rados.rados.0.trial114.stdout:708: done (3 left) 2026-02-20T13:12:20.881 INFO:tasks.rados.rados.0.trial114.stdout:709: done (2 left) 2026-02-20T13:12:20.881 INFO:tasks.rados.rados.0.trial114.stdout:710: done (1 left) 2026-02-20T13:12:20.881 INFO:tasks.rados.rados.0.trial114.stdout:711: done (0 left) 2026-02-20T13:12:20.881 INFO:tasks.rados.rados.0.trial114.stdout:712: write oid 41 current snap is 101 2026-02-20T13:12:20.881 INFO:tasks.rados.rados.0.trial114.stdout:712: seq_num 329 ranges {729503=560100,2019164=716432,3335341=194162} 2026-02-20T13:12:20.885 INFO:tasks.rados.rados.0.trial114.stdout:712: writing trial11441570-41 from 729503 to 1289603 tid 1 2026-02-20T13:12:20.890 INFO:tasks.rados.rados.0.trial114.stdout:712: writing trial11441570-41 from 2019164 to 2735596 tid 2 2026-02-20T13:12:20.894 INFO:tasks.rados.rados.0.trial114.stdout:712: writing trial11441570-41 from 3335341 to 3529503 tid 3 2026-02-20T13:12:20.894 INFO:tasks.rados.rados.0.trial114.stdout:713: delete oid 32 current snap is 101 2026-02-20T13:12:20.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~176s 2026-02-20T13:12:20.938 INFO:tasks.rados.rados.0.trial114.stdout:712: finishing write tid 1 to trial11441570-41 2026-02-20T13:12:20.949 INFO:tasks.rados.rados.0.trial114.stdout:712: finishing write tid 2 to trial11441570-41 2026-02-20T13:12:20.957 INFO:tasks.rados.rados.0.trial114.stdout:712: finishing write tid 3 to trial11441570-41 2026-02-20T13:12:20.963 INFO:tasks.rados.rados.0.trial114.stdout:712: finishing write tid 4 to trial11441570-41 2026-02-20T13:12:20.966 INFO:tasks.rados.rados.0.trial114.stdout:712: finishing write tid 5 to trial11441570-41 2026-02-20T13:12:20.966 INFO:tasks.rados.rados.0.trial114.stdout:712: oid 41 updating version 0 to 146 2026-02-20T13:12:20.966 INFO:tasks.rados.rados.0.trial114.stdout:712: oid 41 version 146 is already newer than 146 2026-02-20T13:12:20.966 INFO:tasks.rados.rados.0.trial114.stdout:712: oid 41 version 146 is already newer than 146 2026-02-20T13:12:20.966 INFO:tasks.rados.rados.0.trial114.stdout:712: oid 41 version 146 is already newer than 146 2026-02-20T13:12:20.966 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 41 v 146 (ObjNum 329 snap 101 seq_num 329) dirty exists 2026-02-20T13:12:20.966 INFO:tasks.rados.rados.0.trial114.stdout:712: left oid 41 (ObjNum 329 snap 101 seq_num 329) 2026-02-20T13:12:20.978 INFO:tasks.rados.rados.0.trial114.stdout:712: done (1 left) 2026-02-20T13:12:20.979 INFO:tasks.rados.rados.0.trial114.stdout:713: done (0 left) 2026-02-20T13:12:20.979 INFO:tasks.rados.rados.0.trial114.stdout:714: snap_create 2026-02-20T13:12:21.279 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:21.332 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:12:21.352 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:21.355 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:21.356 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:21.410 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:21.407+0000 7f5e2c50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:21.412 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:21.410+0000 7f5e2c50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:21.439 INFO:tasks.rados.rados.0.trial114.stdout:714: done (0 left) 2026-02-20T13:12:21.439 INFO:tasks.rados.rados.0.trial114.stdout:715: write (excl) oid 41 current snap is 102 2026-02-20T13:12:21.439 INFO:tasks.rados.rados.0.trial114.stdout:715: seq_num 331 ranges {763117=710598,2136128=720101,3390187=172930} 2026-02-20T13:12:21.441 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:21.444 INFO:tasks.rados.rados.0.trial114.stdout:715: writing trial11441570-41 from 763117 to 1473715 tid 1 2026-02-20T13:12:21.450 INFO:tasks.rados.rados.0.trial114.stdout:715: writing trial11441570-41 from 2136128 to 2856229 tid 2 2026-02-20T13:12:21.453 INFO:tasks.rados.rados.0.trial114.stdout:715: writing trial11441570-41 from 3390187 to 3563117 tid 3 2026-02-20T13:12:21.454 INFO:tasks.rados.rados.0.trial114.stdout:716: read oid 17 snap -1 2026-02-20T13:12:21.454 INFO:tasks.rados.rados.0.trial114.stdout:716: expect deleted 2026-02-20T13:12:21.454 INFO:tasks.rados.rados.0.trial114.stdout:717: snap_create 2026-02-20T13:12:21.470 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:21.471 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:21.480 INFO:tasks.rados.rados.0.trial114.stdout:715: finishing write tid 1 to trial11441570-41 2026-02-20T13:12:21.494 INFO:tasks.rados.rados.0.trial114.stdout:715: finishing write tid 2 to trial11441570-41 2026-02-20T13:12:21.499 INFO:tasks.rados.rados.0.trial114.stdout:715: finishing write tid 3 to trial11441570-41 2026-02-20T13:12:21.503 INFO:tasks.rados.rados.0.trial114.stdout:715: finishing write tid 4 to trial11441570-41 2026-02-20T13:12:21.504 INFO:tasks.rados.rados.0.trial114.stdout:715: finishing write tid 5 to trial11441570-41 2026-02-20T13:12:21.504 INFO:tasks.rados.rados.0.trial114.stdout:715: oid 41 updating version 0 to 151 2026-02-20T13:12:21.504 INFO:tasks.rados.rados.0.trial114.stdout:715: oid 41 version 151 is already newer than 148 2026-02-20T13:12:21.504 INFO:tasks.rados.rados.0.trial114.stdout:715: oid 41 version 151 is already newer than 151 2026-02-20T13:12:21.504 INFO:tasks.rados.rados.0.trial114.stdout:715: oid 41 version 151 is already newer than 151 2026-02-20T13:12:21.504 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 41 v 151 (ObjNum 331 snap 102 seq_num 331) dirty exists 2026-02-20T13:12:21.504 INFO:tasks.rados.rados.0.trial114.stdout:715: left oid 41 (ObjNum 331 snap 102 seq_num 331) 2026-02-20T13:12:22.441 INFO:tasks.rados.rados.0.trial114.stdout:715: done (2 left) 2026-02-20T13:12:22.441 INFO:tasks.rados.rados.0.trial114.stdout:716: done (1 left) 2026-02-20T13:12:22.441 INFO:tasks.rados.rados.0.trial114.stdout:717: done (0 left) 2026-02-20T13:12:22.441 INFO:tasks.rados.rados.0.trial114.stdout:718: write oid 30 current snap is 103 2026-02-20T13:12:22.441 INFO:tasks.rados.rados.0.trial114.stdout:718: seq_num 332 ranges {779924=785847,2078257=580112,3301257=278667} 2026-02-20T13:12:22.447 INFO:tasks.rados.rados.0.trial114.stdout:718: writing trial11441570-30 from 779924 to 1565771 tid 1 2026-02-20T13:12:22.451 INFO:tasks.rados.rados.0.trial114.stdout:718: writing trial11441570-30 from 2078257 to 2658369 tid 2 2026-02-20T13:12:22.455 INFO:tasks.rados.rados.0.trial114.stdout:718: writing trial11441570-30 from 3301257 to 3579924 tid 3 2026-02-20T13:12:22.455 INFO:tasks.rados.rados.0.trial114.stdout:719: write oid 46 current snap is 103 2026-02-20T13:12:22.455 INFO:tasks.rados.rados.0.trial114.stdout:719: seq_num 333 ranges {796731=461096,1736739=723770,2928680=668051} 2026-02-20T13:12:22.460 INFO:tasks.rados.rados.0.trial114.stdout:719: writing trial11441570-46 from 796731 to 1257827 tid 1 2026-02-20T13:12:22.465 INFO:tasks.rados.rados.0.trial114.stdout:719: writing trial11441570-46 from 1736739 to 2460509 tid 2 2026-02-20T13:12:22.469 INFO:tasks.rados.rados.0.trial114.stdout:719: writing trial11441570-46 from 2928680 to 3596731 tid 3 2026-02-20T13:12:22.469 INFO:tasks.rados.rados.0.trial114.stdout:720: snap_remove snap 99 2026-02-20T13:12:23.442 INFO:tasks.rados.rados.0.trial114.stdout:720: done (2 left) 2026-02-20T13:12:23.442 INFO:tasks.rados.rados.0.trial114.stdout:721: read oid 41 snap 87 2026-02-20T13:12:23.442 INFO:tasks.rados.rados.0.trial114.stdout:721: expect (ObjNum 262 snap 80 seq_num 262) 2026-02-20T13:12:23.442 INFO:tasks.rados.rados.0.trial114.stdout:722: write (excl) oid 33 current snap is 103 2026-02-20T13:12:23.443 INFO:tasks.rados.rados.0.trial114.stdout:718: finishing write tid 1 to trial11441570-30 2026-02-20T13:12:23.443 INFO:tasks.rados.rados.0.trial114.stdout:722: seq_num 334 ranges {413538=536345,1395221=583781,2556103=658617} 2026-02-20T13:12:23.445 INFO:tasks.rados.rados.0.trial114.stdout:722: writing trial11441570-33 from 413538 to 949883 tid 1 2026-02-20T13:12:23.449 INFO:tasks.rados.rados.0.trial114.stdout:722: writing trial11441570-33 from 1395221 to 1979002 tid 2 2026-02-20T13:12:23.455 INFO:tasks.rados.rados.0.trial114.stdout:722: writing trial11441570-33 from 2556103 to 3214720 tid 3 2026-02-20T13:12:23.455 INFO:tasks.rados.rados.0.trial114.stdout:723: snap_remove snap 82 2026-02-20T13:12:23.471 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:12:23.547 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:23.543+0000 7f4b10f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:23.549 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:23.547+0000 7f4b10f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:23.577 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:23.592 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:23.593 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:24.444 INFO:tasks.rados.rados.0.trial114.stdout:723: done (4 left) 2026-02-20T13:12:24.444 INFO:tasks.rados.rados.0.trial114.stdout:724: snap_remove snap 100 2026-02-20T13:12:25.450 INFO:tasks.rados.rados.0.trial114.stdout:724: done (4 left) 2026-02-20T13:12:25.450 INFO:tasks.rados.rados.0.trial114.stdout:725: snap_create 2026-02-20T13:12:25.450 INFO:tasks.rados.rados.0.trial114.stdout:718: finishing write tid 2 to trial11441570-30 2026-02-20T13:12:25.450 INFO:tasks.rados.rados.0.trial114.stdout:719: finishing write tid 1 to trial11441570-46 2026-02-20T13:12:25.450 INFO:tasks.rados.rados.0.trial114.stdout:718: finishing write tid 3 to trial11441570-30 2026-02-20T13:12:25.450 INFO:tasks.rados.rados.0.trial114.stdout:719: finishing write tid 2 to trial11441570-46 2026-02-20T13:12:25.450 INFO:tasks.rados.rados.0.trial114.stdout:718: finishing write tid 4 to trial11441570-30 2026-02-20T13:12:25.450 INFO:tasks.rados.rados.0.trial114.stdout:718: finishing write tid 5 to trial11441570-30 2026-02-20T13:12:25.450 INFO:tasks.rados.rados.0.trial114.stdout:718: oid 30 updating version 0 to 297 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:718: oid 30 version 297 is already newer than 297 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:718: oid 30 version 297 is already newer than 297 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:718: oid 30 version 297 is already newer than 297 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 30 v 297 (ObjNum 332 snap 103 seq_num 332) dirty exists 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:718: left oid 30 (ObjNum 332 snap 103 seq_num 332) 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:719: finishing write tid 3 to trial11441570-46 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:719: finishing write tid 4 to trial11441570-46 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:719: finishing write tid 5 to trial11441570-46 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:719: oid 46 updating version 0 to 156 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:719: oid 46 version 156 is already newer than 156 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:719: oid 46 version 156 is already newer than 156 2026-02-20T13:12:25.451 INFO:tasks.rados.rados.0.trial114.stdout:719: oid 46 version 156 is already newer than 156 2026-02-20T13:12:25.452 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 46 v 156 (ObjNum 333 snap 103 seq_num 333) dirty exists 2026-02-20T13:12:25.452 INFO:tasks.rados.rados.0.trial114.stdout:719: left oid 46 (ObjNum 333 snap 103 seq_num 333) 2026-02-20T13:12:25.452 INFO:tasks.rados.rados.0.trial114.stdout:722: finishing write tid 1 to trial11441570-33 2026-02-20T13:12:25.452 INFO:tasks.rados.rados.0.trial114.stdout:721: expect (ObjNum 262 snap 80 seq_num 262) 2026-02-20T13:12:25.488 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 593744 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:722: finishing write tid 2 to trial11441570-33 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:722: finishing write tid 3 to trial11441570-33 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:722: finishing write tid 4 to trial11441570-33 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:722: finishing write tid 5 to trial11441570-33 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:722: oid 33 updating version 0 to 54 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:722: oid 33 version 54 is already newer than 51 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:722: oid 33 version 54 is already newer than 54 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:722: oid 33 version 54 is already newer than 54 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 33 v 54 (ObjNum 334 snap 103 seq_num 334) dirty exists 2026-02-20T13:12:25.504 INFO:tasks.rados.rados.0.trial114.stdout:722: left oid 33 (ObjNum 334 snap 103 seq_num 334) 2026-02-20T13:12:25.593 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:12:25.670 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:25.667+0000 7f269825a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:25.673 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:25.670+0000 7f269825a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:25.699 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:25.713 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:25.714 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:26.356 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:26.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~182s 2026-02-20T13:12:26.428 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:26.430 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:26.431 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:26.456 INFO:tasks.rados.rados.0.trial114.stdout:718: done (4 left) 2026-02-20T13:12:26.456 INFO:tasks.rados.rados.0.trial114.stdout:719: done (3 left) 2026-02-20T13:12:26.456 INFO:tasks.rados.rados.0.trial114.stdout:721: done (2 left) 2026-02-20T13:12:26.456 INFO:tasks.rados.rados.0.trial114.stdout:722: done (1 left) 2026-02-20T13:12:26.456 INFO:tasks.rados.rados.0.trial114.stdout:725: done (0 left) 2026-02-20T13:12:26.457 INFO:tasks.rados.rados.0.trial114.stdout:726: read oid 26 snap -1 2026-02-20T13:12:26.457 INFO:tasks.rados.rados.0.trial114.stdout:726: expect (ObjNum 308 snap 93 seq_num 308) 2026-02-20T13:12:26.457 INFO:tasks.rados.rados.0.trial114.stdout:727: write oid 44 current snap is 104 2026-02-20T13:12:26.457 INFO:tasks.rados.rados.0.trial114.stdout:727: seq_num 335 ranges {430345=727947,1570056=727439,2699879=469889} 2026-02-20T13:12:26.460 INFO:tasks.rados.rados.0.trial114.stdout:727: writing trial11441570-44 from 430345 to 1158292 tid 1 2026-02-20T13:12:26.465 INFO:tasks.rados.rados.0.trial114.stdout:727: writing trial11441570-44 from 1570056 to 2297495 tid 2 2026-02-20T13:12:26.469 INFO:tasks.rados.rados.0.trial114.stdout:727: writing trial11441570-44 from 2699879 to 3169768 tid 3 2026-02-20T13:12:26.469 INFO:tasks.rados.rados.0.trial114.stdout:728: read oid 5 snap -1 2026-02-20T13:12:26.469 INFO:tasks.rados.rados.0.trial114.stdout:728: expect deleted 2026-02-20T13:12:26.470 INFO:tasks.rados.rados.0.trial114.stdout:729: read oid 45 snap -1 2026-02-20T13:12:26.470 INFO:tasks.rados.rados.0.trial114.stdout:729: expect deleted 2026-02-20T13:12:26.470 INFO:tasks.rados.rados.0.trial114.stdout:730: snap_create 2026-02-20T13:12:26.487 INFO:tasks.rados.rados.0.trial114.stdout:726: expect (ObjNum 308 snap 93 seq_num 308) 2026-02-20T13:12:26.487 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:727: finishing write tid 1 to trial11441570-44 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:727: finishing write tid 2 to trial11441570-44 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:727: finishing write tid 3 to trial11441570-44 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:727: finishing write tid 4 to trial11441570-44 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:727: finishing write tid 5 to trial11441570-44 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:727: oid 44 updating version 0 to 306 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:727: oid 44 version 306 is already newer than 306 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:727: oid 44 version 306 is already newer than 306 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:727: oid 44 version 306 is already newer than 306 2026-02-20T13:12:26.572 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 44 v 306 (ObjNum 335 snap 104 seq_num 335) dirty exists 2026-02-20T13:12:26.573 INFO:tasks.rados.rados.0.trial114.stdout:727: left oid 44 (ObjNum 335 snap 104 seq_num 335) 2026-02-20T13:12:27.459 INFO:tasks.rados.rados.0.trial114.stdout:726: done (4 left) 2026-02-20T13:12:27.459 INFO:tasks.rados.rados.0.trial114.stdout:727: done (3 left) 2026-02-20T13:12:27.459 INFO:tasks.rados.rados.0.trial114.stdout:728: done (2 left) 2026-02-20T13:12:27.459 INFO:tasks.rados.rados.0.trial114.stdout:729: done (1 left) 2026-02-20T13:12:27.459 INFO:tasks.rados.rados.0.trial114.stdout:730: done (0 left) 2026-02-20T13:12:27.459 INFO:tasks.rados.rados.0.trial114.stdout:731: write oid 28 current snap is 105 2026-02-20T13:12:27.459 INFO:tasks.rados.rados.0.trial114.stdout:731: seq_num 336 ranges {447152=403196,1512185=587450,2727302=681161} 2026-02-20T13:12:27.461 INFO:tasks.rados.rados.0.trial114.stdout:731: writing trial11441570-28 from 447152 to 850348 tid 1 2026-02-20T13:12:27.466 INFO:tasks.rados.rados.0.trial114.stdout:731: writing trial11441570-28 from 1512185 to 2099635 tid 2 2026-02-20T13:12:27.472 INFO:tasks.rados.rados.0.trial114.stdout:731: writing trial11441570-28 from 2727302 to 3408463 tid 3 2026-02-20T13:12:27.472 INFO:tasks.rados.rados.0.trial114.stdout:732: read oid 8 snap -1 2026-02-20T13:12:27.472 INFO:tasks.rados.rados.0.trial114.stdout:732: expect (ObjNum 317 snap 96 seq_num 317) 2026-02-20T13:12:27.472 INFO:tasks.rados.rados.0.trial114.stdout:733: write (excl) oid 35 current snap is 105 2026-02-20T13:12:27.472 INFO:tasks.rados.rados.0.trial114.stdout:733: seq_num 337 ranges {463959=478445,1570667=731108,3038372=492433} 2026-02-20T13:12:27.475 INFO:tasks.rados.rados.0.trial114.stdout:733: writing trial11441570-35 from 463959 to 942404 tid 1 2026-02-20T13:12:27.481 INFO:tasks.rados.rados.0.trial114.stdout:733: writing trial11441570-35 from 1570667 to 2301775 tid 2 2026-02-20T13:12:27.486 INFO:tasks.rados.rados.0.trial114.stdout:733: writing trial11441570-35 from 3038372 to 3530805 tid 3 2026-02-20T13:12:27.486 INFO:tasks.rados.rados.0.trial114.stdout:734: write oid 50 current snap is 105 2026-02-20T13:12:27.486 INFO:tasks.rados.rados.0.trial114.stdout:734: seq_num 338 ranges {480766=553694,1629149=591119,2782148=420058} 2026-02-20T13:12:27.490 INFO:tasks.rados.rados.0.trial114.stdout:734: writing trial11441570-50 from 480766 to 1034460 tid 1 2026-02-20T13:12:27.495 INFO:tasks.rados.rados.0.trial114.stdout:734: writing trial11441570-50 from 1629149 to 2220268 tid 2 2026-02-20T13:12:27.499 INFO:tasks.rados.rados.0.trial114.stdout:734: writing trial11441570-50 from 2782148 to 3202206 tid 3 2026-02-20T13:12:27.499 INFO:tasks.rados.rados.0.trial114.stdout:735: write oid 26 current snap is 105 2026-02-20T13:12:27.499 INFO:tasks.rados.rados.0.trial114.stdout:735: seq_num 339 ranges {497573=628943,1687631=734777,3093218=604355} 2026-02-20T13:12:27.503 INFO:tasks.rados.rados.0.trial114.stdout:735: writing trial11441570-26 from 497573 to 1126516 tid 1 2026-02-20T13:12:27.508 INFO:tasks.rados.rados.0.trial114.stdout:735: writing trial11441570-26 from 1687631 to 2422408 tid 2 2026-02-20T13:12:27.513 INFO:tasks.rados.rados.0.trial114.stdout:735: writing trial11441570-26 from 3093218 to 3697573 tid 3 2026-02-20T13:12:27.513 INFO:tasks.rados.rados.0.trial114.stdout:736: write oid 42 current snap is 105 2026-02-20T13:12:27.513 INFO:tasks.rados.rados.0.trial114.stdout:732: expect (ObjNum 317 snap 96 seq_num 317) 2026-02-20T13:12:27.540 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 3105507 2026-02-20T13:12:27.545 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 143048 2026-02-20T13:12:27.597 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1161198 2026-02-20T13:12:27.631 INFO:tasks.rados.rados.0.trial114.stdout:733: finishing write tid 1 to trial11441570-35 2026-02-20T13:12:27.632 INFO:tasks.rados.rados.0.trial114.stdout:733: finishing write tid 2 to trial11441570-35 2026-02-20T13:12:27.632 INFO:tasks.rados.rados.0.trial114.stdout:733: finishing write tid 3 to trial11441570-35 2026-02-20T13:12:27.632 INFO:tasks.rados.rados.0.trial114.stdout:734: finishing write tid 1 to trial11441570-50 2026-02-20T13:12:27.632 INFO:tasks.rados.rados.0.trial114.stdout:733: finishing write tid 4 to trial11441570-35 2026-02-20T13:12:27.632 INFO:tasks.rados.rados.0.trial114.stdout:736: seq_num 340 ranges {514380=704192,1629760=478435,2604288=442602} 2026-02-20T13:12:27.636 INFO:tasks.rados.rados.0.trial114.stdout:736: writing trial11441570-42 from 514380 to 1218572 tid 1 2026-02-20T13:12:27.640 INFO:tasks.rados.rados.0.trial114.stdout:736: writing trial11441570-42 from 1629760 to 2108195 tid 2 2026-02-20T13:12:27.645 INFO:tasks.rados.rados.0.trial114.stdout:736: writing trial11441570-42 from 2604288 to 3046890 tid 3 2026-02-20T13:12:27.645 INFO:tasks.rados.rados.0.trial114.stdout:732: done (5 left) 2026-02-20T13:12:27.645 INFO:tasks.rados.rados.0.trial114.stdout:737: delete oid 7 current snap is 105 2026-02-20T13:12:27.645 INFO:tasks.rados.rados.0.trial114.stdout:733: finishing write tid 5 to trial11441570-35 2026-02-20T13:12:27.645 INFO:tasks.rados.rados.0.trial114.stdout:733: oid 35 updating version 0 to 307 2026-02-20T13:12:27.645 INFO:tasks.rados.rados.0.trial114.stdout:733: oid 35 updating version 307 to 310 2026-02-20T13:12:27.645 INFO:tasks.rados.rados.0.trial114.stdout:733: oid 35 version 310 is already newer than 310 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:733: oid 35 version 310 is already newer than 310 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 35 v 310 (ObjNum 337 snap 105 seq_num 337) dirty exists 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:733: left oid 35 (ObjNum 337 snap 105 seq_num 337) 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:735: finishing write tid 1 to trial11441570-26 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:734: finishing write tid 2 to trial11441570-50 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:734: finishing write tid 3 to trial11441570-50 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:735: finishing write tid 2 to trial11441570-26 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:731: finishing write tid 1 to trial11441570-28 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:731: finishing write tid 2 to trial11441570-28 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:735: finishing write tid 3 to trial11441570-26 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:734: finishing write tid 4 to trial11441570-50 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:731: finishing write tid 3 to trial11441570-28 2026-02-20T13:12:27.646 INFO:tasks.rados.rados.0.trial114.stdout:734: finishing write tid 5 to trial11441570-50 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:734: oid 50 updating version 0 to 139 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:734: oid 50 version 139 is already newer than 139 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:734: oid 50 version 139 is already newer than 139 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:734: oid 50 version 139 is already newer than 139 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 50 v 139 (ObjNum 338 snap 105 seq_num 338) dirty exists 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:734: left oid 50 (ObjNum 338 snap 105 seq_num 338) 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:735: finishing write tid 4 to trial11441570-26 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:731: finishing write tid 4 to trial11441570-28 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:735: finishing write tid 5 to trial11441570-26 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:735: oid 26 updating version 0 to 95 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:735: oid 26 version 95 is already newer than 95 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:735: oid 26 version 95 is already newer than 95 2026-02-20T13:12:27.647 INFO:tasks.rados.rados.0.trial114.stdout:735: oid 26 version 95 is already newer than 95 2026-02-20T13:12:27.648 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 26 v 95 (ObjNum 339 snap 105 seq_num 339) dirty exists 2026-02-20T13:12:27.648 INFO:tasks.rados.rados.0.trial114.stdout:735: left oid 26 (ObjNum 339 snap 105 seq_num 339) 2026-02-20T13:12:27.648 INFO:tasks.rados.rados.0.trial114.stdout:731: finishing write tid 5 to trial11441570-28 2026-02-20T13:12:27.648 INFO:tasks.rados.rados.0.trial114.stdout:731: oid 28 updating version 0 to 161 2026-02-20T13:12:27.648 INFO:tasks.rados.rados.0.trial114.stdout:731: oid 28 version 161 is already newer than 161 2026-02-20T13:12:27.648 INFO:tasks.rados.rados.0.trial114.stdout:731: oid 28 version 161 is already newer than 161 2026-02-20T13:12:27.648 INFO:tasks.rados.rados.0.trial114.stdout:731: oid 28 version 161 is already newer than 161 2026-02-20T13:12:27.648 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 28 v 161 (ObjNum 336 snap 105 seq_num 336) dirty exists 2026-02-20T13:12:27.648 INFO:tasks.rados.rados.0.trial114.stdout:731: left oid 28 (ObjNum 336 snap 105 seq_num 336) 2026-02-20T13:12:27.676 INFO:tasks.rados.rados.0.trial114.stdout:736: finishing write tid 1 to trial11441570-42 2026-02-20T13:12:27.683 INFO:tasks.rados.rados.0.trial114.stdout:736: finishing write tid 2 to trial11441570-42 2026-02-20T13:12:27.684 INFO:tasks.rados.rados.0.trial114.stdout:731: done (5 left) 2026-02-20T13:12:27.684 INFO:tasks.rados.rados.0.trial114.stdout:733: done (4 left) 2026-02-20T13:12:27.684 INFO:tasks.rados.rados.0.trial114.stdout:734: done (3 left) 2026-02-20T13:12:27.684 INFO:tasks.rados.rados.0.trial114.stdout:735: done (2 left) 2026-02-20T13:12:27.684 INFO:tasks.rados.rados.0.trial114.stdout:737: done (1 left) 2026-02-20T13:12:27.684 INFO:tasks.rados.rados.0.trial114.stdout:738: delete oid 43 current snap is 105 2026-02-20T13:12:27.689 INFO:tasks.rados.rados.0.trial114.stdout:736: finishing write tid 3 to trial11441570-42 2026-02-20T13:12:27.693 INFO:tasks.rados.rados.0.trial114.stdout:736: finishing write tid 4 to trial11441570-42 2026-02-20T13:12:27.695 INFO:tasks.rados.rados.0.trial114.stdout:736: finishing write tid 5 to trial11441570-42 2026-02-20T13:12:27.695 INFO:tasks.rados.rados.0.trial114.stdout:736: oid 42 updating version 0 to 59 2026-02-20T13:12:27.695 INFO:tasks.rados.rados.0.trial114.stdout:736: oid 42 version 59 is already newer than 59 2026-02-20T13:12:27.695 INFO:tasks.rados.rados.0.trial114.stdout:736: oid 42 version 59 is already newer than 59 2026-02-20T13:12:27.695 INFO:tasks.rados.rados.0.trial114.stdout:736: oid 42 version 59 is already newer than 59 2026-02-20T13:12:27.695 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 42 v 59 (ObjNum 340 snap 105 seq_num 340) dirty exists 2026-02-20T13:12:27.695 INFO:tasks.rados.rados.0.trial114.stdout:736: left oid 42 (ObjNum 340 snap 105 seq_num 340) 2026-02-20T13:12:27.715 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:12:27.716 INFO:tasks.rados.rados.0.trial114.stdout:736: done (1 left) 2026-02-20T13:12:27.716 INFO:tasks.rados.rados.0.trial114.stdout:738: done (0 left) 2026-02-20T13:12:27.716 INFO:tasks.rados.rados.0.trial114.stdout:739: delete oid 46 current snap is 105 2026-02-20T13:12:27.743 INFO:tasks.rados.rados.0.trial114.stdout:739: done (0 left) 2026-02-20T13:12:27.744 INFO:tasks.rados.rados.0.trial114.stdout:740: delete oid 47 current snap is 105 2026-02-20T13:12:27.774 INFO:tasks.rados.rados.0.trial114.stdout:740: done (0 left) 2026-02-20T13:12:27.774 INFO:tasks.rados.rados.0.trial114.stdout:741: delete oid 44 current snap is 105 2026-02-20T13:12:27.791 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:27.788+0000 7fa40fa5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:27.794 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:27.791+0000 7fa40fa5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:27.804 INFO:tasks.rados.rados.0.trial114.stdout:741: done (0 left) 2026-02-20T13:12:27.804 INFO:tasks.rados.rados.0.trial114.stdout:742: write (excl) oid 14 current snap is 105 2026-02-20T13:12:27.804 INFO:tasks.rados.rados.0.trial114.stdout:742: seq_num 346 ranges {615222=472039,1580652=489442,2768826=626587} 2026-02-20T13:12:27.808 INFO:tasks.rados.rados.0.trial114.stdout:742: writing trial11441570-14 from 615222 to 1087261 tid 1 2026-02-20T13:12:27.812 INFO:tasks.rados.rados.0.trial114.stdout:742: writing trial11441570-14 from 1580652 to 2070094 tid 2 2026-02-20T13:12:27.817 INFO:tasks.rados.rados.0.trial114.stdout:742: writing trial11441570-14 from 2768826 to 3395413 tid 3 2026-02-20T13:12:27.817 INFO:tasks.rados.rados.0.trial114.stdout:743: snap_create 2026-02-20T13:12:27.826 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:27.826 INFO:tasks.rados.rados.0.trial114.stdout:742: finishing write tid 1 to trial11441570-14 2026-02-20T13:12:27.839 INFO:tasks.rados.rados.0.trial114.stdout:742: finishing write tid 2 to trial11441570-14 2026-02-20T13:12:27.842 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:27.842 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:27.845 INFO:tasks.rados.rados.0.trial114.stdout:742: finishing write tid 3 to trial11441570-14 2026-02-20T13:12:27.851 INFO:tasks.rados.rados.0.trial114.stdout:742: finishing write tid 4 to trial11441570-14 2026-02-20T13:12:27.854 INFO:tasks.rados.rados.0.trial114.stdout:742: finishing write tid 5 to trial11441570-14 2026-02-20T13:12:27.854 INFO:tasks.rados.rados.0.trial114.stdout:742: oid 14 updating version 0 to 53 2026-02-20T13:12:27.854 INFO:tasks.rados.rados.0.trial114.stdout:742: oid 14 updating version 53 to 56 2026-02-20T13:12:27.854 INFO:tasks.rados.rados.0.trial114.stdout:742: oid 14 version 56 is already newer than 56 2026-02-20T13:12:27.854 INFO:tasks.rados.rados.0.trial114.stdout:742: oid 14 version 56 is already newer than 56 2026-02-20T13:12:27.854 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 14 v 56 (ObjNum 346 snap 105 seq_num 346) dirty exists 2026-02-20T13:12:27.854 INFO:tasks.rados.rados.0.trial114.stdout:742: left oid 14 (ObjNum 346 snap 105 seq_num 346) 2026-02-20T13:12:28.463 INFO:tasks.rados.rados.0.trial114.stdout:742: done (1 left) 2026-02-20T13:12:28.463 INFO:tasks.rados.rados.0.trial114.stdout:743: done (0 left) 2026-02-20T13:12:28.463 INFO:tasks.rados.rados.0.trial114.stdout:744: delete oid 1 current snap is 106 2026-02-20T13:12:28.478 INFO:tasks.rados.rados.0.trial114.stdout:744: done (0 left) 2026-02-20T13:12:28.478 INFO:tasks.rados.rados.0.trial114.stdout:745: write oid 25 current snap is 106 2026-02-20T13:12:28.478 INFO:tasks.rados.rados.0.trial114.stdout:745: seq_num 348 ranges {648836=622537,1981263=493111,3107319=741517} 2026-02-20T13:12:28.483 INFO:tasks.rados.rados.0.trial114.stdout:745: writing trial11441570-25 from 648836 to 1271373 tid 1 2026-02-20T13:12:28.488 INFO:tasks.rados.rados.0.trial114.stdout:745: writing trial11441570-25 from 1981263 to 2474374 tid 2 2026-02-20T13:12:28.493 INFO:tasks.rados.rados.0.trial114.stdout:745: writing trial11441570-25 from 3107319 to 3848836 tid 3 2026-02-20T13:12:28.493 INFO:tasks.rados.rados.0.trial114.stdout:746: write oid 37 current snap is 106 2026-02-20T13:12:28.494 INFO:tasks.rados.rados.0.trial114.stdout:746: seq_num 349 ranges {665643=697786,2039745=753122,3534742=330901} 2026-02-20T13:12:28.498 INFO:tasks.rados.rados.0.trial114.stdout:746: writing trial11441570-37 from 665643 to 1363429 tid 1 2026-02-20T13:12:28.504 INFO:tasks.rados.rados.0.trial114.stdout:746: writing trial11441570-37 from 2039745 to 2792867 tid 2 2026-02-20T13:12:28.508 INFO:tasks.rados.rados.0.trial114.stdout:746: writing trial11441570-37 from 3534742 to 3865643 tid 3 2026-02-20T13:12:28.508 INFO:tasks.rados.rados.0.trial114.stdout:747: snap_create 2026-02-20T13:12:28.528 INFO:tasks.rados.rados.0.trial114.stdout:745: finishing write tid 1 to trial11441570-25 2026-02-20T13:12:28.534 INFO:tasks.rados.rados.0.trial114.stdout:745: finishing write tid 2 to trial11441570-25 2026-02-20T13:12:28.541 INFO:tasks.rados.rados.0.trial114.stdout:745: finishing write tid 3 to trial11441570-25 2026-02-20T13:12:28.542 INFO:tasks.rados.rados.0.trial114.stdout:746: finishing write tid 1 to trial11441570-37 2026-02-20T13:12:28.545 INFO:tasks.rados.rados.0.trial114.stdout:745: finishing write tid 4 to trial11441570-25 2026-02-20T13:12:28.547 INFO:tasks.rados.rados.0.trial114.stdout:745: finishing write tid 5 to trial11441570-25 2026-02-20T13:12:28.547 INFO:tasks.rados.rados.0.trial114.stdout:745: oid 25 updating version 0 to 179 2026-02-20T13:12:28.547 INFO:tasks.rados.rados.0.trial114.stdout:745: oid 25 version 179 is already newer than 179 2026-02-20T13:12:28.547 INFO:tasks.rados.rados.0.trial114.stdout:745: oid 25 version 179 is already newer than 179 2026-02-20T13:12:28.547 INFO:tasks.rados.rados.0.trial114.stdout:745: oid 25 version 179 is already newer than 179 2026-02-20T13:12:28.548 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 25 v 179 (ObjNum 348 snap 106 seq_num 348) dirty exists 2026-02-20T13:12:28.548 INFO:tasks.rados.rados.0.trial114.stdout:745: left oid 25 (ObjNum 348 snap 106 seq_num 348) 2026-02-20T13:12:28.549 INFO:tasks.rados.rados.0.trial114.stdout:746: finishing write tid 2 to trial11441570-37 2026-02-20T13:12:28.554 INFO:tasks.rados.rados.0.trial114.stdout:746: finishing write tid 3 to trial11441570-37 2026-02-20T13:12:28.558 INFO:tasks.rados.rados.0.trial114.stdout:746: finishing write tid 4 to trial11441570-37 2026-02-20T13:12:28.560 INFO:tasks.rados.rados.0.trial114.stdout:746: finishing write tid 5 to trial11441570-37 2026-02-20T13:12:28.560 INFO:tasks.rados.rados.0.trial114.stdout:746: oid 37 updating version 0 to 321 2026-02-20T13:12:28.560 INFO:tasks.rados.rados.0.trial114.stdout:746: oid 37 version 321 is already newer than 321 2026-02-20T13:12:28.560 INFO:tasks.rados.rados.0.trial114.stdout:746: oid 37 version 321 is already newer than 321 2026-02-20T13:12:28.560 INFO:tasks.rados.rados.0.trial114.stdout:746: oid 37 version 321 is already newer than 321 2026-02-20T13:12:28.560 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 37 v 321 (ObjNum 349 snap 106 seq_num 349) dirty exists 2026-02-20T13:12:28.560 INFO:tasks.rados.rados.0.trial114.stdout:746: left oid 37 (ObjNum 349 snap 106 seq_num 349) 2026-02-20T13:12:29.385 INFO:tasks.rados.rados.0.trial114.stdout:745: done (2 left) 2026-02-20T13:12:29.385 INFO:tasks.rados.rados.0.trial114.stdout:746: done (1 left) 2026-02-20T13:12:29.386 INFO:tasks.rados.rados.0.trial114.stdout:747: done (0 left) 2026-02-20T13:12:29.386 INFO:tasks.rados.rados.0.trial114.stdout:748: write oid 23 current snap is 107 2026-02-20T13:12:29.386 INFO:tasks.rados.rados.0.trial114.stdout:748: seq_num 350 ranges {682450=489388,1814580=496780,2878518=788028} 2026-02-20T13:12:29.389 INFO:tasks.rados.rados.0.trial114.stdout:748: writing trial11441570-23 from 682450 to 1171838 tid 1 2026-02-20T13:12:29.393 INFO:tasks.rados.rados.0.trial114.stdout:748: writing trial11441570-23 from 1814580 to 2311360 tid 2 2026-02-20T13:12:29.399 INFO:tasks.rados.rados.0.trial114.stdout:748: writing trial11441570-23 from 2878518 to 3666546 tid 3 2026-02-20T13:12:29.399 INFO:tasks.rados.rados.0.trial114.stdout:749: snap_create 2026-02-20T13:12:29.416 INFO:tasks.rados.rados.0.trial114.stdout:748: finishing write tid 1 to trial11441570-23 2026-02-20T13:12:29.421 INFO:tasks.rados.rados.0.trial114.stdout:748: finishing write tid 2 to trial11441570-23 2026-02-20T13:12:29.434 INFO:tasks.rados.rados.0.trial114.stdout:748: finishing write tid 3 to trial11441570-23 2026-02-20T13:12:29.434 INFO:tasks.rados.rados.0.trial114.stdout:748: finishing write tid 4 to trial11441570-23 2026-02-20T13:12:29.434 INFO:tasks.rados.rados.0.trial114.stdout:748: finishing write tid 5 to trial11441570-23 2026-02-20T13:12:29.434 INFO:tasks.rados.rados.0.trial114.stdout:748: oid 23 updating version 0 to 315 2026-02-20T13:12:29.434 INFO:tasks.rados.rados.0.trial114.stdout:748: oid 23 version 315 is already newer than 315 2026-02-20T13:12:29.434 INFO:tasks.rados.rados.0.trial114.stdout:748: oid 23 version 315 is already newer than 315 2026-02-20T13:12:29.434 INFO:tasks.rados.rados.0.trial114.stdout:748: oid 23 version 315 is already newer than 315 2026-02-20T13:12:29.434 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 23 v 315 (ObjNum 350 snap 107 seq_num 350) dirty exists 2026-02-20T13:12:29.435 INFO:tasks.rados.rados.0.trial114.stdout:748: left oid 23 (ObjNum 350 snap 107 seq_num 350) 2026-02-20T13:12:29.843 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:12:29.919 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:29.915+0000 7f69cc08b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:29.921 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:29.919+0000 7f69cc08b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:29.947 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:29.962 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:29.963 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:30.386 INFO:tasks.rados.rados.0.trial114.stdout:748: done (1 left) 2026-02-20T13:12:30.386 INFO:tasks.rados.rados.0.trial114.stdout:749: done (0 left) 2026-02-20T13:12:30.387 INFO:tasks.rados.rados.0.trial114.stdout:750: read oid 17 snap -1 2026-02-20T13:12:30.387 INFO:tasks.rados.rados.0.trial114.stdout:750: expect deleted 2026-02-20T13:12:30.387 INFO:tasks.rados.rados.0.trial114.stdout:751: read oid 50 snap -1 2026-02-20T13:12:30.387 INFO:tasks.rados.rados.0.trial114.stdout:751: expect (ObjNum 338 snap 105 seq_num 338) 2026-02-20T13:12:30.387 INFO:tasks.rados.rados.0.trial114.stdout:752: snap_remove snap 94 2026-02-20T13:12:31.387 INFO:tasks.rados.rados.0.trial114.stdout:752: done (2 left) 2026-02-20T13:12:31.388 INFO:tasks.rados.rados.0.trial114.stdout:753: write oid 19 current snap is 108 2026-02-20T13:12:31.388 INFO:tasks.rados.rados.0.trial114.stdout:753: seq_num 351 ranges {699257=564637,1873062=640438,3305941=593316} 2026-02-20T13:12:31.392 INFO:tasks.rados.rados.0.trial114.stdout:753: writing trial11441570-19 from 699257 to 1263894 tid 1 2026-02-20T13:12:31.397 INFO:tasks.rados.rados.0.trial114.stdout:753: writing trial11441570-19 from 1873062 to 2513500 tid 2 2026-02-20T13:12:31.403 INFO:tasks.rados.rados.0.trial114.stdout:753: writing trial11441570-19 from 3305941 to 3899257 tid 3 2026-02-20T13:12:31.403 INFO:tasks.rados.rados.0.trial114.stdout:754: snap_remove snap 81 2026-02-20T13:12:31.433 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:31.503 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:31.505 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:31.506 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:31.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~187s 2026-02-20T13:12:31.964 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T13:12:32.041 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:32.038+0000 7f2d7e8b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:32.044 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:32.041+0000 7f2d7e8b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:32.070 INFO:teuthology.orchestra.run.trial114.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T13:12:32.086 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T13:12:32.087 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:12:32.390 INFO:tasks.rados.rados.0.trial114.stdout:754: done (3 left) 2026-02-20T13:12:32.390 INFO:tasks.rados.rados.0.trial114.stdout:755: read oid 33 snap -1 2026-02-20T13:12:32.390 INFO:tasks.rados.rados.0.trial114.stdout:755: expect (ObjNum 334 snap 103 seq_num 334) 2026-02-20T13:12:32.390 INFO:tasks.rados.rados.0.trial114.stdout:756: read oid 9 snap -1 2026-02-20T13:12:32.390 INFO:tasks.rados.rados.0.trial114.stdout:756: expect (ObjNum 260 snap 80 seq_num 260) 2026-02-20T13:12:32.390 INFO:tasks.rados.rados.0.trial114.stdout:757: write oid 43 current snap is 108 2026-02-20T13:12:32.390 INFO:tasks.rados.rados.0.trial114.stdout:757: seq_num 352 ranges {716064=639886,1815191=500449,2817011=526925} 2026-02-20T13:12:32.394 INFO:tasks.rados.rados.0.trial114.stdout:757: writing trial11441570-43 from 716064 to 1355950 tid 1 2026-02-20T13:12:32.398 INFO:tasks.rados.rados.0.trial114.stdout:757: writing trial11441570-43 from 1815191 to 2315640 tid 2 2026-02-20T13:12:32.403 INFO:tasks.rados.rados.0.trial114.stdout:757: writing trial11441570-43 from 2817011 to 3343936 tid 3 2026-02-20T13:12:32.403 INFO:tasks.rados.rados.0.trial114.stdout:758: delete oid 13 current snap is 108 2026-02-20T13:12:32.403 INFO:tasks.rados.rados.0.trial114.stdout:751: expect (ObjNum 338 snap 105 seq_num 338) 2026-02-20T13:12:32.403 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:32.523 INFO:tasks.rados.rados.0.trial114.stdout:750: done (6 left) 2026-02-20T13:12:32.523 INFO:tasks.rados.rados.0.trial114.stdout:751: done (5 left) 2026-02-20T13:12:32.523 INFO:tasks.rados.rados.0.trial114.stdout:758: done (4 left) 2026-02-20T13:12:32.523 INFO:tasks.rados.rados.0.trial114.stdout:759: write oid 26 current snap is 108 2026-02-20T13:12:32.523 INFO:tasks.rados.rados.0.trial114.stdout:753: finishing write tid 1 to trial11441570-19 2026-02-20T13:12:32.523 INFO:tasks.rados.rados.0.trial114.stdout:759: seq_num 354 ranges {749678=790384,2332155=504118,3271857=549469} 2026-02-20T13:12:32.528 INFO:tasks.rados.rados.0.trial114.stdout:759: writing trial11441570-26 from 749678 to 1540062 tid 1 2026-02-20T13:12:32.533 INFO:tasks.rados.rados.0.trial114.stdout:759: writing trial11441570-26 from 2332155 to 2836273 tid 2 2026-02-20T13:12:32.537 INFO:tasks.rados.rados.0.trial114.stdout:759: writing trial11441570-26 from 3271857 to 3821326 tid 3 2026-02-20T13:12:32.537 INFO:tasks.rados.rados.0.trial114.stdout:760: write (excl) oid 1 current snap is 108 2026-02-20T13:12:32.537 INFO:tasks.rados.rados.0.trial114.stdout:753: finishing write tid 2 to trial11441570-19 2026-02-20T13:12:32.538 INFO:tasks.rados.rados.0.trial114.stdout:753: finishing write tid 3 to trial11441570-19 2026-02-20T13:12:32.538 INFO:tasks.rados.rados.0.trial114.stdout:753: finishing write tid 4 to trial11441570-19 2026-02-20T13:12:32.538 INFO:tasks.rados.rados.0.trial114.stdout:760: seq_num 355 ranges {766485=465633,1990637=647776,3299280=667205} 2026-02-20T13:12:32.541 INFO:tasks.rados.rados.0.trial114.stdout:760: writing trial11441570-1 from 766485 to 1232118 tid 1 2026-02-20T13:12:32.547 INFO:tasks.rados.rados.0.trial114.stdout:760: writing trial11441570-1 from 1990637 to 2638413 tid 2 2026-02-20T13:12:32.553 INFO:tasks.rados.rados.0.trial114.stdout:760: writing trial11441570-1 from 3299280 to 3966485 tid 3 2026-02-20T13:12:32.553 INFO:tasks.rados.rados.0.trial114.stdout:761: read oid 46 snap 62 2026-02-20T13:12:32.553 INFO:tasks.rados.rados.0.trial114.stdout:761: expect (ObjNum 192 snap 60 seq_num 192) 2026-02-20T13:12:32.553 INFO:tasks.rados.rados.0.trial114.stdout:762: write oid 3 current snap is 108 2026-02-20T13:12:32.553 INFO:tasks.rados.rados.0.trial114.stdout:753: finishing write tid 5 to trial11441570-19 2026-02-20T13:12:32.553 INFO:tasks.rados.rados.0.trial114.stdout:753: oid 19 updating version 0 to 144 2026-02-20T13:12:32.553 INFO:tasks.rados.rados.0.trial114.stdout:753: oid 19 version 144 is already newer than 144 2026-02-20T13:12:32.553 INFO:tasks.rados.rados.0.trial114.stdout:753: oid 19 version 144 is already newer than 144 2026-02-20T13:12:32.554 INFO:tasks.rados.rados.0.trial114.stdout:753: oid 19 version 144 is already newer than 144 2026-02-20T13:12:32.554 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 19 v 144 (ObjNum 351 snap 108 seq_num 351) dirty exists 2026-02-20T13:12:32.554 INFO:tasks.rados.rados.0.trial114.stdout:753: left oid 19 (ObjNum 351 snap 108 seq_num 351) 2026-02-20T13:12:32.554 INFO:tasks.rados.rados.0.trial114.stdout:762: seq_num 356 ranges {783292=540882,1932766=507787,3210350=572013} 2026-02-20T13:12:32.557 INFO:tasks.rados.rados.0.trial114.stdout:762: writing trial11441570-3 from 783292 to 1324174 tid 1 2026-02-20T13:12:32.562 INFO:tasks.rados.rados.0.trial114.stdout:762: writing trial11441570-3 from 1932766 to 2440553 tid 2 2026-02-20T13:12:32.567 INFO:tasks.rados.rados.0.trial114.stdout:762: writing trial11441570-3 from 3210350 to 3782363 tid 3 2026-02-20T13:12:32.567 INFO:tasks.rados.rados.0.trial114.stdout:753: done (7 left) 2026-02-20T13:12:32.567 INFO:tasks.rados.rados.0.trial114.stdout:763: write (excl) oid 2 current snap is 108 2026-02-20T13:12:32.567 INFO:tasks.rados.rados.0.trial114.stdout:763: seq_num 357 ranges {400099=616131,1591248=408851} 2026-02-20T13:12:32.571 INFO:tasks.rados.rados.0.trial114.stdout:763: writing trial11441570-2 from 400099 to 1016230 tid 1 2026-02-20T13:12:32.575 INFO:tasks.rados.rados.0.trial114.stdout:763: writing trial11441570-2 from 1591248 to 2000099 tid 2 2026-02-20T13:12:32.575 INFO:tasks.rados.rados.0.trial114.stdout:764: write (excl) oid 27 current snap is 108 2026-02-20T13:12:32.575 INFO:tasks.rados.rados.0.trial114.stdout:764: seq_num 358 ranges {416906=407733,1366083=511456} 2026-02-20T13:12:32.578 INFO:tasks.rados.rados.0.trial114.stdout:764: writing trial11441570-27 from 416906 to 824639 tid 1 2026-02-20T13:12:32.582 INFO:tasks.rados.rados.0.trial114.stdout:764: writing trial11441570-27 from 1366083 to 1877539 tid 2 2026-02-20T13:12:32.582 INFO:tasks.rados.rados.0.trial114.stdout:765: read oid 49 snap -1 2026-02-20T13:12:32.583 INFO:tasks.rados.rados.0.trial114.stdout:765: expect (ObjNum 285 snap 87 seq_num 285) 2026-02-20T13:12:32.583 INFO:tasks.rados.rados.0.trial114.stdout:766: read oid 41 snap -1 2026-02-20T13:12:32.583 INFO:tasks.rados.rados.0.trial114.stdout:766: expect (ObjNum 331 snap 102 seq_num 331) 2026-02-20T13:12:32.583 INFO:tasks.rados.rados.0.trial114.stdout:767: write oid 7 current snap is 108 2026-02-20T13:12:32.583 INFO:tasks.rados.rados.0.trial114.stdout:767: seq_num 359 ranges {433713=482982,1424565=609148} 2026-02-20T13:12:32.586 INFO:tasks.rados.rados.0.trial114.stdout:767: writing trial11441570-7 from 433713 to 916695 tid 1 2026-02-20T13:12:32.590 INFO:tasks.rados.rados.0.trial114.stdout:767: writing trial11441570-7 from 1424565 to 2033713 tid 2 2026-02-20T13:12:32.590 INFO:tasks.rados.rados.0.trial114.stdout:768: write (excl) oid 4 current snap is 108 2026-02-20T13:12:32.590 INFO:tasks.rados.rados.0.trial114.stdout:756: expect (ObjNum 260 snap 80 seq_num 260) 2026-02-20T13:12:32.611 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:32.632 INFO:tasks.rados.rados.0.trial114.stdout:755: expect (ObjNum 334 snap 103 seq_num 334) 2026-02-20T13:12:32.632 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:32.665 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 852861 2026-02-20T13:12:32.689 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:32.719 INFO:tasks.rados.rados.0.trial114.stdout:757: finishing write tid 1 to trial11441570-43 2026-02-20T13:12:32.719 INFO:tasks.rados.rados.0.trial114.stdout:757: finishing write tid 2 to trial11441570-43 2026-02-20T13:12:32.719 INFO:tasks.rados.rados.0.trial114.stdout:757: finishing write tid 3 to trial11441570-43 2026-02-20T13:12:32.719 INFO:tasks.rados.rados.0.trial114.stdout:768: seq_num 360 ranges {450520=558231,1483047=515125} 2026-02-20T13:12:32.723 INFO:tasks.rados.rados.0.trial114.stdout:768: writing trial11441570-4 from 450520 to 1008751 tid 1 2026-02-20T13:12:32.727 INFO:tasks.rados.rados.0.trial114.stdout:768: writing trial11441570-4 from 1483047 to 1998172 tid 2 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:755: done (12 left) 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:756: done (11 left) 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:769: read oid 30 snap -1 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:769: expect (ObjNum 332 snap 103 seq_num 332) 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:770: read oid 23 snap -1 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:770: expect (ObjNum 350 snap 107 seq_num 350) 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:771: write (excl) oid 17 current snap is 108 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:757: finishing write tid 4 to trial11441570-43 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:757: finishing write tid 5 to trial11441570-43 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:757: oid 43 updating version 0 to 329 2026-02-20T13:12:32.728 INFO:tasks.rados.rados.0.trial114.stdout:757: oid 43 version 329 is already newer than 329 2026-02-20T13:12:32.729 INFO:tasks.rados.rados.0.trial114.stdout:757: oid 43 version 329 is already newer than 329 2026-02-20T13:12:32.729 INFO:tasks.rados.rados.0.trial114.stdout:757: oid 43 version 329 is already newer than 329 2026-02-20T13:12:32.729 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 43 v 329 (ObjNum 352 snap 108 seq_num 352) dirty exists 2026-02-20T13:12:32.729 INFO:tasks.rados.rados.0.trial114.stdout:757: left oid 43 (ObjNum 352 snap 108 seq_num 352) 2026-02-20T13:12:32.729 INFO:tasks.rados.rados.0.trial114.stdout:771: seq_num 361 ranges {467327=633480,1825176=242151} 2026-02-20T13:12:32.731 INFO:tasks.rados.rados.0.trial114.stdout:771: writing trial11441570-17 from 467327 to 1100807 tid 1 2026-02-20T13:12:32.735 INFO:tasks.rados.rados.0.trial114.stdout:771: writing trial11441570-17 from 1825176 to 2067327 tid 2 2026-02-20T13:12:32.735 INFO:tasks.rados.rados.0.trial114.stdout:757: done (13 left) 2026-02-20T13:12:32.735 INFO:tasks.rados.rados.0.trial114.stdout:772: snap_create 2026-02-20T13:12:32.735 INFO:tasks.rados.rados.0.trial114.stdout:760: finishing write tid 1 to trial11441570-1 2026-02-20T13:12:32.735 INFO:tasks.rados.rados.0.trial114.stdout:759: finishing write tid 1 to trial11441570-26 2026-02-20T13:12:32.735 INFO:tasks.rados.rados.0.trial114.stdout:759: finishing write tid 2 to trial11441570-26 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:759: finishing write tid 3 to trial11441570-26 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:759: finishing write tid 4 to trial11441570-26 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:759: finishing write tid 5 to trial11441570-26 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:759: oid 26 updating version 0 to 100 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:759: oid 26 version 100 is already newer than 100 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:759: oid 26 version 100 is already newer than 100 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:759: oid 26 version 100 is already newer than 100 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 26 v 100 (ObjNum 354 snap 108 seq_num 354) dirty exists 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:759: left oid 26 (ObjNum 354 snap 108 seq_num 354) 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:760: finishing write tid 2 to trial11441570-1 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:760: finishing write tid 3 to trial11441570-1 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:762: finishing write tid 1 to trial11441570-3 2026-02-20T13:12:32.736 INFO:tasks.rados.rados.0.trial114.stdout:760: finishing write tid 4 to trial11441570-1 2026-02-20T13:12:32.737 INFO:tasks.rados.rados.0.trial114.stdout:761: expect (ObjNum 192 snap 60 seq_num 192) 2026-02-20T13:12:32.848 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 2677417 2026-02-20T13:12:32.857 INFO:tasks.rados.rados.0.trial114.stdout:760: finishing write tid 5 to trial11441570-1 2026-02-20T13:12:32.857 INFO:tasks.rados.rados.0.trial114.stdout:760: oid 1 updating version 0 to 152 2026-02-20T13:12:32.857 INFO:tasks.rados.rados.0.trial114.stdout:760: oid 1 version 152 is already newer than 152 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:760: oid 1 version 152 is already newer than 152 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:760: oid 1 version 152 is already newer than 149 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 1 v 152 (ObjNum 355 snap 108 seq_num 355) dirty exists 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:760: left oid 1 (ObjNum 355 snap 108 seq_num 355) 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:767: finishing write tid 1 to trial11441570-7 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:764: finishing write tid 1 to trial11441570-27 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:762: finishing write tid 2 to trial11441570-3 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:767: finishing write tid 2 to trial11441570-7 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:767: finishing write tid 3 to trial11441570-7 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:767: finishing write tid 4 to trial11441570-7 2026-02-20T13:12:32.858 INFO:tasks.rados.rados.0.trial114.stdout:767: oid 7 updating version 0 to 326 2026-02-20T13:12:32.859 INFO:tasks.rados.rados.0.trial114.stdout:767: oid 7 version 326 is already newer than 326 2026-02-20T13:12:32.859 INFO:tasks.rados.rados.0.trial114.stdout:767: oid 7 version 326 is already newer than 326 2026-02-20T13:12:32.859 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 7 v 326 (ObjNum 359 snap 108 seq_num 359) dirty exists 2026-02-20T13:12:32.859 INFO:tasks.rados.rados.0.trial114.stdout:767: left oid 7 (ObjNum 359 snap 108 seq_num 359) 2026-02-20T13:12:32.859 INFO:tasks.rados.rados.0.trial114.stdout:763: finishing write tid 1 to trial11441570-2 2026-02-20T13:12:32.859 INFO:tasks.rados.rados.0.trial114.stdout:765: expect (ObjNum 285 snap 87 seq_num 285) 2026-02-20T13:12:32.859 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:32.905 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 28763 2026-02-20T13:12:32.929 INFO:tasks.rados.rados.0.trial114.stdout:762: finishing write tid 3 to trial11441570-3 2026-02-20T13:12:32.929 INFO:tasks.rados.rados.0.trial114.stdout:763: finishing write tid 2 to trial11441570-2 2026-02-20T13:12:32.929 INFO:tasks.rados.rados.0.trial114.stdout:764: finishing write tid 2 to trial11441570-27 2026-02-20T13:12:32.929 INFO:tasks.rados.rados.0.trial114.stdout:763: finishing write tid 3 to trial11441570-2 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:763: finishing write tid 4 to trial11441570-2 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:763: oid 2 updating version 0 to 47 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:763: oid 2 updating version 47 to 49 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:763: oid 2 version 49 is already newer than 49 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 2 v 49 (ObjNum 357 snap 108 seq_num 357) dirty exists 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:763: left oid 2 (ObjNum 357 snap 108 seq_num 357) 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:762: finishing write tid 4 to trial11441570-3 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:762: finishing write tid 5 to trial11441570-3 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:762: oid 3 updating version 0 to 127 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:762: oid 3 version 127 is already newer than 127 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:762: oid 3 version 127 is already newer than 127 2026-02-20T13:12:32.930 INFO:tasks.rados.rados.0.trial114.stdout:762: oid 3 version 127 is already newer than 127 2026-02-20T13:12:32.931 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 3 v 127 (ObjNum 356 snap 108 seq_num 356) dirty exists 2026-02-20T13:12:32.931 INFO:tasks.rados.rados.0.trial114.stdout:762: left oid 3 (ObjNum 356 snap 108 seq_num 356) 2026-02-20T13:12:32.931 INFO:tasks.rados.rados.0.trial114.stdout:764: finishing write tid 3 to trial11441570-27 2026-02-20T13:12:32.931 INFO:tasks.rados.rados.0.trial114.stdout:766: expect (ObjNum 331 snap 102 seq_num 331) 2026-02-20T13:12:32.931 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:32.980 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:33.032 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:33.085 INFO:tasks.rados.rados.0.trial114.stdout:764: finishing write tid 4 to trial11441570-27 2026-02-20T13:12:33.085 INFO:tasks.rados.rados.0.trial114.stdout:764: oid 27 updating version 0 to 166 2026-02-20T13:12:33.085 INFO:tasks.rados.rados.0.trial114.stdout:764: oid 27 version 166 is already newer than 164 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:764: oid 27 version 166 is already newer than 166 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 27 v 166 (ObjNum 358 snap 108 seq_num 358) dirty exists 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:764: left oid 27 (ObjNum 358 snap 108 seq_num 358) 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:768: finishing write tid 1 to trial11441570-4 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:771: finishing write tid 1 to trial11441570-17 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:768: finishing write tid 2 to trial11441570-4 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:768: finishing write tid 3 to trial11441570-4 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:768: finishing write tid 4 to trial11441570-4 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:768: oid 4 updating version 0 to 43 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:768: oid 4 version 43 is already newer than 43 2026-02-20T13:12:33.086 INFO:tasks.rados.rados.0.trial114.stdout:768: oid 4 version 43 is already newer than 41 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 4 v 43 (ObjNum 360 snap 108 seq_num 360) dirty exists 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:768: left oid 4 (ObjNum 360 snap 108 seq_num 360) 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:771: finishing write tid 2 to trial11441570-17 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:771: finishing write tid 3 to trial11441570-17 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:771: finishing write tid 4 to trial11441570-17 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:771: oid 17 updating version 0 to 155 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:771: oid 17 version 155 is already newer than 153 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:771: oid 17 version 155 is already newer than 155 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:update_object_version oid 17 v 155 (ObjNum 361 snap 108 seq_num 361) dirty exists 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:771: left oid 17 (ObjNum 361 snap 108 seq_num 361) 2026-02-20T13:12:33.087 INFO:tasks.rados.rados.0.trial114.stdout:769: expect (ObjNum 332 snap 103 seq_num 332) 2026-02-20T13:12:33.152 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:33.276 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 3273107 2026-02-20T13:12:33.283 INFO:tasks.rados.rados.0.trial114.stdout:770: expect (ObjNum 350 snap 107 seq_num 350) 2026-02-20T13:12:33.330 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:33.394 INFO:tasks.rados.rados.0.trial114.stdout:759: done (13 left) 2026-02-20T13:12:33.394 INFO:tasks.rados.rados.0.trial114.stdout:760: done (12 left) 2026-02-20T13:12:33.394 INFO:tasks.rados.rados.0.trial114.stdout:761: done (11 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:762: done (10 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:763: done (9 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:764: done (8 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:765: done (7 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:766: done (6 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:767: done (5 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:768: done (4 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:769: done (3 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:770: done (2 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:771: done (1 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:772: done (0 left) 2026-02-20T13:12:33.395 INFO:tasks.rados.rados.0.trial114.stdout:773: snap_create 2026-02-20T13:12:34.088 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T13:12:34.163 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:34.159+0000 7fdb85211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:34.165 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:12:34.162+0000 7fdb85211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:12:34.395 INFO:tasks.rados.rados.0.trial114.stdout:773: done (0 left) 2026-02-20T13:12:34.395 INFO:tasks.rados.rados.0.trial114.stdout:774: read oid 24 snap 105 2026-02-20T13:12:34.396 INFO:tasks.rados.rados.0.trial114.stdout:774: expect deleted 2026-02-20T13:12:34.396 INFO:tasks.rados.rados.0.trial114.stdout:775: write (excl) oid 50 current snap is 110 2026-02-20T13:12:34.396 INFO:tasks.rados.rados.0.trial114.stdout:775: seq_num 362 ranges {484134=708729,1883658=200476} 2026-02-20T13:12:34.399 INFO:tasks.rados.rados.0.trial114.stdout:775: writing trial11441570-50 from 484134 to 1192863 tid 1 2026-02-20T13:12:34.403 INFO:tasks.rados.rados.0.trial114.stdout:775: writing trial11441570-50 from 1883658 to 2084134 tid 2 2026-02-20T13:12:34.403 INFO:tasks.rados.rados.0.trial114.stdout:776: read oid 36 snap -1 2026-02-20T13:12:34.404 INFO:tasks.rados.rados.0.trial114.stdout:776: expect (ObjNum 289 snap 90 seq_num 289) 2026-02-20T13:12:34.404 INFO:tasks.rados.rados.0.trial114.stdout:777: read oid 16 snap -1 2026-02-20T13:12:34.404 INFO:tasks.rados.rados.0.trial114.stdout:777: expect deleted 2026-02-20T13:12:34.404 INFO:tasks.rados.rados.0.trial114.stdout:778: read oid 30 snap 87 2026-02-20T13:12:34.404 INFO:tasks.rados.rados.0.trial114.stdout:778: expect (ObjNum 195 snap 61 seq_num 195) 2026-02-20T13:12:34.404 INFO:tasks.rados.rados.0.trial114.stdout:779: read oid 42 snap 91 2026-02-20T13:12:34.404 INFO:tasks.rados.rados.0.trial114.stdout:779: expect (ObjNum 286 snap 87 seq_num 286) 2026-02-20T13:12:34.404 INFO:tasks.rados.rados.0.trial114.stdout:780: snap_create 2026-02-20T13:12:34.439 INFO:tasks.rados.rados.0.trial114.stdout:779: expect (ObjNum 286 snap 87 seq_num 286) 2026-02-20T13:12:34.439 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:34.477 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:34.516 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 529538 2026-02-20T13:12:34.548 INFO:tasks.rados.rados.0.trial114.stdout:776: expect (ObjNum 289 snap 90 seq_num 289) 2026-02-20T13:12:34.548 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 295832 2026-02-20T13:12:34.583 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1075129 2026-02-20T13:12:35.399 INFO:tasks.rados.rados.0.trial114.stdout:776: done (6 left) 2026-02-20T13:12:35.399 INFO:tasks.rados.rados.0.trial114.stdout:779: done (5 left) 2026-02-20T13:12:35.400 INFO:tasks.rados.rados.0.trial114.stdout:780: done (4 left) 2026-02-20T13:12:35.400 INFO:tasks.rados.rados.0.trial114.stdout:781: delete oid 21 current snap is 111 2026-02-20T13:12:35.448 INFO:tasks.rados.rados.0.trial114.stdout:781: done (4 left) 2026-02-20T13:12:35.448 INFO:tasks.rados.rados.0.trial114.stdout:782: write oid 36 current snap is 111 2026-02-20T13:12:35.449 INFO:tasks.rados.rados.0.trial114.stdout:782: seq_num 364 ranges {517748=459227,1600622=406110} 2026-02-20T13:12:35.452 INFO:tasks.rados.rados.0.trial114.stdout:782: writing trial11441570-36 from 517748 to 976975 tid 1 2026-02-20T13:12:35.457 INFO:tasks.rados.rados.0.trial114.stdout:782: writing trial11441570-36 from 1600622 to 2006732 tid 2 2026-02-20T13:12:35.457 INFO:tasks.rados.rados.0.trial114.stdout:783: snap_remove snap 98 2026-02-20T13:12:36.402 INFO:tasks.rados.rados.0.trial114.stdout:783: done (5 left) 2026-02-20T13:12:36.403 INFO:tasks.rados.rados.0.trial114.stdout:784: read oid 28 snap 105 2026-02-20T13:12:36.403 INFO:tasks.rados.rados.0.trial114.stdout:784: expect (ObjNum 336 snap 105 seq_num 336) 2026-02-20T13:12:36.403 INFO:tasks.rados.rados.0.trial114.stdout:785: delete oid 13 current snap is 111 2026-02-20T13:12:36.433 INFO:tasks.rados.rados.0.trial114.stdout:784: expect (ObjNum 336 snap 105 seq_num 336) 2026-02-20T13:12:36.477 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 0 2026-02-20T13:12:36.507 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:36.524 INFO:tasks.rados.rados.0.trial114.stdout:seeking to 1264740 2026-02-20T13:12:36.579 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:36.582 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:36.582 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:37.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~193s 2026-02-20T13:12:41.584 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:41.656 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:41.659 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:41.660 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:42.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~198s 2026-02-20T13:12:46.661 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:46.733 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:46.736 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:46.737 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:48.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~204s 2026-02-20T13:12:51.738 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:51.812 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:51.814 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:51.815 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:53.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~209s 2026-02-20T13:12:56.816 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:12:56.887 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:12:56.890 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:12:56.891 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:12:59.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2026-02-20T13:13:01.892 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:01.963 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:01.966 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:01.967 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:04.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~220s 2026-02-20T13:13:06.968 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:07.039 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:07.041 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:07.042 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:10.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~226s 2026-02-20T13:13:12.043 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:12.113 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:12.115 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:12.116 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:15.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~231s 2026-02-20T13:13:17.117 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:17.188 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:17.191 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:17.192 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:21.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~237s 2026-02-20T13:13:22.193 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:22.265 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:22.268 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:22.269 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:26.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~242s 2026-02-20T13:13:27.270 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:27.341 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:27.344 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:27.345 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:32.346 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:32.417 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:32.419 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:32.420 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:32.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~248s 2026-02-20T13:13:37.421 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:37.491 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:37.494 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:37.494 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:37.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~253s 2026-02-20T13:13:42.495 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:42.565 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:42.568 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:42.568 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:43.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~259s 2026-02-20T13:13:47.570 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:47.641 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:47.644 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:47.644 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:48.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~264s 2026-02-20T13:13:52.646 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:52.716 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:52.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:52.720 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:54.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~270s 2026-02-20T13:13:57.721 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:13:57.791 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:13:57.794 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:13:57.794 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:13:59.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~275s 2026-02-20T13:14:02.795 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:02.863 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:02.865 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:02.866 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:05.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~281s 2026-02-20T13:14:07.868 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:07.938 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:07.941 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:07.941 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:10.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~286s 2026-02-20T13:14:12.943 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:13.014 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:13.016 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:13.017 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:16.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~292s 2026-02-20T13:14:18.018 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:18.088 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:18.091 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:18.092 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:22.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~297s 2026-02-20T13:14:23.093 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:23.165 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:23.167 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:23.168 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:27.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~303s 2026-02-20T13:14:27.506 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2026-02-20T13:14:28.010 INFO:tasks.ceph.osd.0:Sent signal 15 2026-02-20T13:14:28.010 INFO:tasks.ceph.osd.1:Sent signal 15 2026-02-20T13:14:28.011 INFO:tasks.ceph.osd.3:Sent signal 15 2026-02-20T13:14:28.011 INFO:tasks.ceph.mon.a:Sent signal 15 2026-02-20T13:14:28.011 INFO:tasks.ceph.mgr.x:Sent signal 15 2026-02-20T13:14:28.011 INFO:tasks.daemonwatchdog.daemon_watchdog:Killing thrasher OSDThrasher 2026-02-20T13:14:28.012 INFO:tasks.ceph.mgr.x.trial185.stderr:2026-02-20T13:14:28.010+0000 7ff2cabf8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 38908) UID: 0 2026-02-20T13:14:28.012 INFO:tasks.ceph.mgr.x.trial185.stderr:2026-02-20T13:14:28.010+0000 7ff2cabf8640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-20T13:14:28.013 INFO:tasks.ceph.mon.a.trial114.stderr:2026-02-20T13:14:28.009+0000 7f645bdfc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 39731) UID: 0 2026-02-20T13:14:28.013 INFO:tasks.ceph.mon.a.trial114.stderr:2026-02-20T13:14:28.009+0000 7f645bdfc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-20T13:14:28.169 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:28.242 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:28.244 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:28.245 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:33.246 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:33.320 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:33.323 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:33.324 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:34.118 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T13:14:34.118 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T13:14:38.324 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:38.395 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:38.398 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:38.398 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:43.400 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:43.471 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:43.474 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:43.475 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:48.476 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:48.546 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:48.549 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:48.550 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:53.550 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:53.620 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:53.623 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:53.623 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:14:58.624 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:14:58.696 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:14:58.698 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:14:58.699 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:15:03.700 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:15:03.771 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:15:03.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:15:03.775 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:15:08.776 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:15:08.847 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:15:08.850 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:15:08.850 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:15:13.852 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:15:13.923 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:15:13.926 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:15:13.926 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:15:18.927 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:15:18.999 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:15:19.001 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:15:19.002 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T13:15:24.003 DEBUG:teuthology.orchestra.run.trial185:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T13:15:24.074 INFO:teuthology.orchestra.run.trial185.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T13:15:24.077 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T13:15:24.080 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.2 restart 2026-02-20T13:15:24.081 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1384, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.2 restart 2026-02-20T13:15:24.082 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T13:15:24.082 INFO:tasks.daemonwatchdog.daemon_watchdog:Killing remote process ceph-test-rados-ceph 2026-02-20T13:15:24.082 DEBUG:tasks.rados:Stopping ceph-test-rados-ceph due to exception The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T13:15:24.082 INFO:tasks.rados:Stopping instance 0 2026-02-20T13:15:24.093 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T13:15:24.095 ERROR:teuthology.run_tasks:Manager failed: rados Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T13:15:24.098 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2026-02-20T13:15:24.114 INFO:tasks.thrashosds:joining thrashosds 2026-02-20T13:15:24.114 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T13:15:24.114 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T13:15:24.115 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T13:15:24.212 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:15:24.207+0000 7f6dd943d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:17:24.166 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T13:17:24.167 ERROR:teuthology.run_tasks:Manager failed: thrashosds Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2026-02-20T13:17:24.172 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T13:17:24.187 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T13:17:24.188 DEBUG:teuthology.orchestra.run.trial114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T13:17:24.265 INFO:teuthology.orchestra.run.trial114.stderr:2026-02-20T13:17:24.261+0000 7fb907e11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:19:24.221 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T13:19:24.222 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T13:19:24.226 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T13:19:24.226 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T13:19:24.226 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T13:19:24.227 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:19:24.302 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T13:19:24.302 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T13:19:24.302 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:19:24.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:19:24.302 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 1525, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial114 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log' 2026-02-20T13:19:24.308 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T13:19:24.308 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T13:19:24.308 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:19:24.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:19:24.308 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 1525, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial185 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log' 2026-02-20T13:19:24.313 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T13:19:24.313 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T13:19:24.313 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:19:24.375 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T13:19:24.375 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T13:19:24.375 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T13:19:24.375 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:19:24.376 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T13:19:24.376 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T13:19:24.376 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T13:19:24.376 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:19:24.376 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T13:19:24.376 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T13:19:24.377 DEBUG:teuthology.orchestra.run.trial114:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'objects unfound and apparently lost' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | head -n 1 2026-02-20T13:19:24.405 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial114.front.sepia.ceph.com 2026-02-20T13:19:24.406 DEBUG:teuthology.orchestra.run.trial114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T13:19:24.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial114.front.sepia.ceph.com 2026-02-20T13:19:24.472 DEBUG:teuthology.orchestra.run.trial114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T13:19:24.538 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial185.front.sepia.ceph.com 2026-02-20T13:19:24.539 DEBUG:teuthology.orchestra.run.trial185:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T13:19:24.568 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial185.front.sepia.ceph.com 2026-02-20T13:19:24.568 DEBUG:teuthology.orchestra.run.trial185:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-20T13:19:24.636 INFO:tasks.ceph:Archiving mon data... 2026-02-20T13:19:24.638 DEBUG:teuthology.misc:Transferring archived files from trial114:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756/data/mon.a.tgz 2026-02-20T13:19:24.638 DEBUG:teuthology.orchestra.run.trial114:> mktemp 2026-02-20T13:19:24.656 INFO:teuthology.orchestra.run.trial114.stdout:/tmp/tmp.DYoqkOOMqw 2026-02-20T13:19:24.656 DEBUG:teuthology.orchestra.run.trial114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.DYoqkOOMqw 2026-02-20T13:19:24.758 DEBUG:teuthology.orchestra.run.trial114:> sudo chmod 0666 /tmp/tmp.DYoqkOOMqw 2026-02-20T13:19:24.842 DEBUG:teuthology.orchestra.remote:trial114:/tmp/tmp.DYoqkOOMqw is 302KB 2026-02-20T13:19:24.931 DEBUG:teuthology.orchestra.run.trial114:> rm -fr /tmp/tmp.DYoqkOOMqw 2026-02-20T13:19:24.949 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T13:19:24.949 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T13:19:24.992 DEBUG:teuthology.orchestra.run.trial185:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T13:19:25.072 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T13:19:25.090 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T13:19:25.090 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T13:19:25.093 DEBUG:teuthology.misc:Transferring archived files from trial114:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756/remote/trial114/crash 2026-02-20T13:19:25.094 DEBUG:teuthology.orchestra.run.trial114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T13:19:25.138 DEBUG:teuthology.misc:Transferring archived files from trial185:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756/remote/trial185/crash 2026-02-20T13:19:25.140 DEBUG:teuthology.orchestra.run.trial185:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T13:19:25.167 INFO:tasks.ceph:Compressing logs... 2026-02-20T13:19:25.167 DEBUG:teuthology.orchestra.run.trial114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:19:25.184 DEBUG:teuthology.orchestra.run.trial185:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:19:25.206 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T13:19:25.243 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T13:19:25.243 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-20T13:19:25.243 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39055.log 2026-02-20T13:19:25.243 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39160.log 2026-02-20T13:19:25.244 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.39055.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-20T13:19:25.244 INFO:teuthology.orchestra.run.trial185.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.39055.log.gz 2026-02-20T13:19:25.244 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.39160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39102.log 2026-02-20T13:19:25.244 INFO:teuthology.orchestra.run.trial185.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39160.log.gz 2026-02-20T13:19:25.244 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39008.log 2026-02-20T13:19:25.244 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.39102.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39102.log.gz 2026-02-20T13:19:25.244 INFO:teuthology.orchestra.run.trial185.stderr:/var/log/ceph/ceph-client.admin.39008.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39008.log.gz 2026-02-20T13:19:25.250 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47094.log 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41176.log 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47094.log.gz 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40980.log 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42322.log 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41176.log.gz 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45093.log 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40980.log.gz 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41400.log 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42322.log.gz 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45797.log 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45093.log.gz 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41400.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41400.log.gz 2026-02-20T13:19:25.251 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45797.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.45905.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45797.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42378.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45905.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45417.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42378.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43578.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41301.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43578.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45417.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46121.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43578.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43687.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41301.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41301.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46121.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46121.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43742.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40392.log 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43687.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43742.log: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.43742.log.gz 2026-02-20T13:19:25.252 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47603.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41662.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40392.log.gz 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47310.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47603.log.gz 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41662.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41662.log.gz 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47202.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44607.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47310.log.gz 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47202.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47202.log.gz 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45635.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47804.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44607.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44607.log.gz 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42742.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45635.log.gz 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41523.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr: 8.0% -- replaced with /var/log/ceph/ceph-client.admin.47804.log.gz 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42742.log: gzip 50.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.42742.log.gz -- 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr: /var/log/ceph/ceph-client.admin.43069.log 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41523.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41523.log.gz 2026-02-20T13:19:25.253 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39734.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45581.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43069.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.39734.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39734.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43013.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40812.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45581.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43013.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43013.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40173.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46337.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40812.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40173.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40173.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47364.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46337.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47364.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47364.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40343.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44228.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40343.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40343.log.gz 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40816.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42105.log 2026-02-20T13:19:25.254 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44228.log.gz 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40075.log 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40816.log.gz 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42105.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42105.log.gz 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39820.log 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41613.log 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40075.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40075.log.gz 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.39820.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39820.log.gz 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45201.log 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41613.log.gz 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44120.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44499.log 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44715.log 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.45201.log.gz 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44499.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44499.log.gz 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2026-02-20T13:19:25.255 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46769.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44715.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45527.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45255.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46769.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38678.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46769.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45255.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45255.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41078.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph.tmp-client.admin.38678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42798.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38678.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41078.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41078.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44553.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42798.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46661.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46283.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40620.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44553.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46283.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.46283.log.gz 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2026-02-20T13:19:25.256 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43523.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40620.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47040.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45959.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43523.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47040.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47040.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44282.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40815.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45959.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43342.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44282.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43632.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40815.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:gzip/var/log/ceph/ceph-client.admin.43342.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43342.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44390.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45743.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45473.log 2026-02-20T13:19:25.257 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43850.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44390.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45039.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.45473.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44012.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43850.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43850.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44336.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45039.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45689.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44012.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42049.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44336.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40490.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45689.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47473.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42049.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40490.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42908.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47473.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47473.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45147.log 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2026-02-20T13:19:25.258 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46931.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42908.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42908.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45147.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45147.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46067.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46715.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46931.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46229.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46067.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46067.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46715.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46715.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44823.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44174.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46229.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44823.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41570.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44174.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44445.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.0.41570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45309.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.0.41570.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46391.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45851.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45309.log: 87.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45309.log.gz 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44931.log 2026-02-20T13:19:25.259 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46391.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46986.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45851.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43230.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44931.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42852.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46986.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43230.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43230.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42852.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42852.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43796.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44985.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40441.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43796.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43469.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44985.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42266.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40441.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46823.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43469.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47858.log 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42266.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46823.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46823.log.gz 2026-02-20T13:19:25.260 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40617.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47858.log: 8.8% -- replaced with /var/log/ceph/ceph-client.admin.47858.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40617.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41401.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42161.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41903.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41401.log: /var/log/ceph/ceph-client.admin.42161.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41401.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42161.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45363.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41903.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41903.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40243.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.45363.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45363.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42210.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43286.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40243.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42210.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42210.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40101.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47148.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43286.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40101.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40101.log.gz 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41474.log 2026-02-20T13:19:25.261 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47148.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41474.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41474.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43408.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40931.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40619.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46499.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43408.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40619.log: gzip -5 50.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.40619.log.gz -- 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr: /var/log/ceph/ceph-client.admin.47419.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42539.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46499.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47419.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47419.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40616.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42539.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44661.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40616.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40616.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43175.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46445.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44661.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41029.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43175.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46445.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46445.log.gz 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47256.log 2026-02-20T13:19:25.262 INFO:teuthology.orchestra.run.trial114.stderr: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41029.log: 48.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41029.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40814.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.47256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44769.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47256.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43904.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40814.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44769.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44769.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41225.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.43904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42427.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43904.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.41225.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41225.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42427.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42427.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39867.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46013.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.39867.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39867.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46877.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46013.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46877.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46877.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40270.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.44877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42483.log 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.40270.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.40270.log.gz 2026-02-20T13:19:25.263 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46607.log 2026-02-20T13:19:25.264 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.42483.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42483.log.gz 2026-02-20T13:19:25.264 INFO:teuthology.orchestra.run.trial114.stderr:/var/log/ceph/ceph-client.admin.46607.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46607.log.gz 2026-02-20T13:19:25.276 INFO:teuthology.orchestra.run.trial185.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T13:19:25.391 INFO:teuthology.orchestra.run.trial114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T13:19:26.236 INFO:teuthology.orchestra.run.trial185.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T13:19:26.920 INFO:teuthology.orchestra.run.trial185.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-20T13:19:26.922 INFO:teuthology.orchestra.run.trial185.stderr: 2026-02-20T13:19:26.922 INFO:teuthology.orchestra.run.trial185.stderr:real 0m1.694s 2026-02-20T13:19:26.922 INFO:teuthology.orchestra.run.trial185.stderr:user 0m2.589s 2026-02-20T13:19:26.922 INFO:teuthology.orchestra.run.trial185.stderr:sys 0m0.149s 2026-02-20T13:19:26.932 INFO:teuthology.orchestra.run.trial114.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T13:19:27.111 INFO:teuthology.orchestra.run.trial114.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T13:19:27.113 INFO:teuthology.orchestra.run.trial114.stderr: 2026-02-20T13:19:27.113 INFO:teuthology.orchestra.run.trial114.stderr:real 0m1.915s 2026-02-20T13:19:27.114 INFO:teuthology.orchestra.run.trial114.stderr:user 0m3.623s 2026-02-20T13:19:27.114 INFO:teuthology.orchestra.run.trial114.stderr:sys 0m0.266s 2026-02-20T13:19:27.114 INFO:tasks.ceph:Archiving logs... 2026-02-20T13:19:27.114 DEBUG:teuthology.misc:Transferring archived files from trial114:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756/remote/trial114/log 2026-02-20T13:19:27.116 DEBUG:teuthology.orchestra.run.trial114:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T13:19:27.665 DEBUG:teuthology.misc:Transferring archived files from trial185:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756/remote/trial185/log 2026-02-20T13:19:27.666 DEBUG:teuthology.orchestra.run.trial185:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T13:19:27.969 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial114 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T13:19:27.970 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T13:19:27.979 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T13:19:28.092 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T13:19:28.103 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T13:19:28.104 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T13:19:28.104 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T13:19:28.106 DEBUG:teuthology.orchestra.run.trial185:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T13:19:28.132 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T13:19:28.144 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T13:19:28.144 DEBUG:teuthology.orchestra.run.trial114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:19:28.173 DEBUG:teuthology.orchestra.run.trial185:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:19:28.186 INFO:teuthology.orchestra.run.trial114.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:19:28.187 INFO:teuthology.orchestra.run.trial185.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:19:28.732 INFO:teuthology.orchestra.run.trial185.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:19:28.732 INFO:teuthology.orchestra.run.trial185.stdout:=============================================================================== 2026-02-20T13:19:28.732 INFO:teuthology.orchestra.run.trial185.stdout:^* blotch.image1tech.net 2 7 377 81 -723us[ -554us] +/- 22ms 2026-02-20T13:19:28.732 INFO:teuthology.orchestra.run.trial185.stdout:^+ 172-104-209-204.ip.linod> 4 6 377 13 +999us[ +999us] +/- 33ms 2026-02-20T13:19:28.732 INFO:teuthology.orchestra.run.trial185.stdout:^+ kjsl-fmt2-net.fmt2.kjsl.> 2 7 377 17 +458us[ +458us] +/- 34ms 2026-02-20T13:19:28.732 INFO:teuthology.orchestra.run.trial185.stdout:^+ 66.42.71.197.vultruserco> 2 6 377 145 -90us[ +63us] +/- 47ms 2026-02-20T13:19:28.734 INFO:teuthology.orchestra.run.trial114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:19:28.735 INFO:teuthology.orchestra.run.trial114.stdout:=============================================================================== 2026-02-20T13:19:28.735 INFO:teuthology.orchestra.run.trial114.stdout:^* blotch.image1tech.net 2 7 377 81 -905us[ -863us] +/- 22ms 2026-02-20T13:19:28.735 INFO:teuthology.orchestra.run.trial114.stdout:^+ 172-104-209-204.ip.linod> 4 7 377 81 +708us[ +749us] +/- 33ms 2026-02-20T13:19:28.735 INFO:teuthology.orchestra.run.trial114.stdout:^+ kjsl-fmt2-net.fmt2.kjsl.> 2 7 377 80 +110us[ +110us] +/- 33ms 2026-02-20T13:19:28.735 INFO:teuthology.orchestra.run.trial114.stdout:^- network190-139.c1d.net 2 6 377 17 +7516us[+7516us] +/- 84ms 2026-02-20T13:19:28.735 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T13:19:28.752 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T13:19:28.752 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T13:19:28.767 DEBUG:teuthology.orchestra.run.trial114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T13:19:28.830 DEBUG:teuthology.orchestra.run.trial185:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T13:19:28.884 DEBUG:teuthology.orchestra.run.trial114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T13:19:28.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:19:28.913 DEBUG:teuthology.orchestra.run.trial185:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T13:19:28.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:19:28.940 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T13:19:28.957 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T13:19:28.973 INFO:teuthology.task.internal:Duration was 1505.692549 seconds 2026-02-20T13:19:28.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T13:19:28.989 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T13:19:28.989 DEBUG:teuthology.orchestra.run.trial114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T13:19:28.992 DEBUG:teuthology.orchestra.run.trial185:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T13:19:29.027 INFO:teuthology.orchestra.run.trial114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:19:29.028 INFO:teuthology.orchestra.run.trial185.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:19:29.311 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T13:19:29.311 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial114.front.sepia.ceph.com 2026-02-20T13:19:29.311 DEBUG:teuthology.orchestra.run.trial114:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T13:19:29.370 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial185.front.sepia.ceph.com 2026-02-20T13:19:29.370 DEBUG:teuthology.orchestra.run.trial185:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T13:19:29.391 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T13:19:29.392 DEBUG:teuthology.orchestra.run.trial114:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:19:29.412 DEBUG:teuthology.orchestra.run.trial185:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:19:29.493 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T13:19:29.494 DEBUG:teuthology.orchestra.run.trial114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:19:29.496 DEBUG:teuthology.orchestra.run.trial185:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:19:29.516 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:19:29.518 INFO:teuthology.orchestra.run.trial114.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:19:29.518 INFO:teuthology.orchestra.run.trial114.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:19:29.518 INFO:teuthology.orchestra.run.trial114.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T13:19:29.518 INFO:teuthology.orchestra.run.trial114.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T13:19:29.519 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:19:29.520 INFO:teuthology.orchestra.run.trial185.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:19:29.520 INFO:teuthology.orchestra.run.trial185.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:19:29.520 INFO:teuthology.orchestra.run.trial185.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T13:19:29.521 INFO:teuthology.orchestra.run.trial185.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T13:19:29.528 INFO:teuthology.orchestra.run.trial114.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T13:19:29.531 INFO:teuthology.orchestra.run.trial185.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T13:19:29.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T13:19:29.551 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T13:19:29.551 DEBUG:teuthology.orchestra.run.trial114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T13:19:29.594 DEBUG:teuthology.orchestra.run.trial185:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T13:19:29.619 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T13:19:29.637 DEBUG:teuthology.orchestra.run.trial114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:19:29.640 DEBUG:teuthology.orchestra.run.trial185:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:19:29.661 INFO:teuthology.orchestra.run.trial114.stdout:kernel.core_pattern = core 2026-02-20T13:19:29.684 INFO:teuthology.orchestra.run.trial185.stdout:kernel.core_pattern = core 2026-02-20T13:19:29.716 DEBUG:teuthology.orchestra.run.trial114:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:19:29.730 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:19:29.731 DEBUG:teuthology.orchestra.run.trial185:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:19:29.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:19:29.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T13:19:29.791 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T13:19:29.792 DEBUG:teuthology.misc:Transferring archived files from trial114:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756/remote/trial114 2026-02-20T13:19:29.792 DEBUG:teuthology.orchestra.run.trial114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T13:19:29.829 DEBUG:teuthology.misc:Transferring archived files from trial185:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:29:19-crimson-rados-wip-perezjos-crimson-only-12-02-2026-PR66245-distro-debug-trial/60756/remote/trial185 2026-02-20T13:19:29.829 DEBUG:teuthology.orchestra.run.trial185:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T13:19:29.860 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T13:19:29.860 DEBUG:teuthology.orchestra.run.trial114:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T13:19:29.863 DEBUG:teuthology.orchestra.run.trial185:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T13:19:29.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T13:19:29.922 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T13:19:29.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T13:19:29.936 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T13:19:29.936 DEBUG:teuthology.orchestra.run.trial114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T13:19:29.937 DEBUG:teuthology.orchestra.run.trial185:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T13:19:29.951 INFO:teuthology.orchestra.run.trial114.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 13:19 /home/ubuntu/cephtest 2026-02-20T13:19:29.965 INFO:teuthology.orchestra.run.trial185.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 13:19 /home/ubuntu/cephtest 2026-02-20T13:19:29.966 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T13:19:29.977 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T13:19:29.991 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T13:19:29.993 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented_2q} thrashers/{default} thrashosds-health workloads/snaps-few-objects-balanced} duration: 1505.6925489902496 failure_reason: The WatchDog barked due to Daemon ceph.osd.2 has failed flavor: debug owner: scheduled_jjperez@soko04.front.sepia.ceph.com status: fail success: false 2026-02-20T13:19:29.993 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T13:19:30.088 INFO:teuthology.run:FAIL