2026-02-20T11:22:45.209 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-20T11:22:45.224 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:22:45.309 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517 branch: wip-perezjos-crimson-only-19-02-2026-PR64439 description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/snaps-few-objects} email: null first_in_suite: false flavor: debug job_id: '60517' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-perezjos-crimson-only-19-02-2026-PR64439 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd target transaction size: 5 seastore cachepin size pershard: 64M seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 445d5c9ba18a4040e70e25303230c36c77773acb owner: scheduled_jjperez@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1736 sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 445d5c9ba18a4040e70e25303230c36c77773acb targets: trial046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG3h7C5vi7eDg2Sa3ddjF++HSiyXlHfr3CUVOacgQ/VTj0b1G5C5laCro/pWiDS+/oAIkEK9eSSDnFhKE0xSeT0= trial086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIpPc0AOoYb3a/PhnLh5g3awsMCims0/Yb/ndGjDu/hVuTYQkVdhTKVzIjG5S3ijSoWGIZx/kXL5ae6eZ9c+W4= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: ceph_objectstore_tool: false chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 chance_trim_stale_osdmaps: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - rados: clients: - client.0 objects: 50 op_weights: copy_from: 0 delete: 50 read: 100 rollback: 0 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-20_10:21:31 tube: trial user: jjperez verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T11:22:45.309 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa; will attempt to use it 2026-02-20T11:22:45.309 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks 2026-02-20T11:22:45.309 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T11:22:45.311 INFO:teuthology.task.internal:Checking packages... 2026-02-20T11:22:45.311 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4' 2026-02-20T11:22:45.311 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T11:22:45.311 INFO:teuthology.packaging:ref: None 2026-02-20T11:22:45.311 INFO:teuthology.packaging:tag: None 2026-02-20T11:22:45.311 INFO:teuthology.packaging:branch: wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:22:45.311 INFO:teuthology.packaging:sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:22:45.311 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:22:45.430 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5357.g0c3148ca 2026-02-20T11:22:45.431 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T11:22:45.443 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T11:22:45.443 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T11:22:45.456 INFO:teuthology.task.internal:Saving configuration 2026-02-20T11:22:45.469 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T11:22:45.480 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T11:22:47.810 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial046.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:19:11.024496', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG3h7C5vi7eDg2Sa3ddjF++HSiyXlHfr3CUVOacgQ/VTj0b1G5C5laCro/pWiDS+/oAIkEK9eSSDnFhKE0xSeT0='} 2026-02-20T11:22:47.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial086.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:19:11.023930', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIpPc0AOoYb3a/PhnLh5g3awsMCims0/Yb/ndGjDu/hVuTYQkVdhTKVzIjG5S3ijSoWGIZx/kXL5ae6eZ9c+W4='} 2026-02-20T11:22:47.868 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T11:22:47.879 INFO:teuthology.task.internal:roles: ubuntu@trial046.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-20T11:22:47.879 INFO:teuthology.task.internal:roles: ubuntu@trial086.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-20T11:22:47.879 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T11:22:49.145 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7344e97e6a20>, signals=[15]) 2026-02-20T11:22:49.145 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T11:22:49.158 INFO:teuthology.task.internal:Opening connections... 2026-02-20T11:22:49.158 DEBUG:teuthology.task.internal:connecting to ubuntu@trial046.front.sepia.ceph.com 2026-02-20T11:22:49.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:22:49.220 DEBUG:teuthology.task.internal:connecting to ubuntu@trial086.front.sepia.ceph.com 2026-02-20T11:22:49.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:22:49.281 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T11:22:49.293 DEBUG:teuthology.orchestra.run.trial046:> uname -m 2026-02-20T11:22:49.308 INFO:teuthology.orchestra.run.trial046.stdout:x86_64 2026-02-20T11:22:49.308 DEBUG:teuthology.orchestra.run.trial046:> cat /etc/os-release 2026-02-20T11:22:49.364 INFO:teuthology.orchestra.run.trial046.stdout:NAME="CentOS Stream" 2026-02-20T11:22:49.364 INFO:teuthology.orchestra.run.trial046.stdout:VERSION="9" 2026-02-20T11:22:49.364 INFO:teuthology.orchestra.run.trial046.stdout:ID="centos" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:VERSION_ID="9" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:ANSI_COLOR="0;31" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:22:49.365 INFO:teuthology.orchestra.run.trial046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:22:49.365 INFO:teuthology.lock.ops:Updating trial046.front.sepia.ceph.com on lock server 2026-02-20T11:22:49.435 DEBUG:teuthology.orchestra.run.trial086:> uname -m 2026-02-20T11:22:49.450 INFO:teuthology.orchestra.run.trial086.stdout:x86_64 2026-02-20T11:22:49.450 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release 2026-02-20T11:22:49.505 INFO:teuthology.orchestra.run.trial086.stdout:NAME="CentOS Stream" 2026-02-20T11:22:49.505 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="9" 2026-02-20T11:22:49.505 INFO:teuthology.orchestra.run.trial086.stdout:ID="centos" 2026-02-20T11:22:49.505 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:22:49.505 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="9" 2026-02-20T11:22:49.505 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:22:49.505 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:22:49.506 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;31" 2026-02-20T11:22:49.506 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:22:49.506 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:22:49.506 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:22:49.506 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:22:49.506 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:22:49.506 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:22:49.506 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server 2026-02-20T11:22:49.577 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T11:22:49.588 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T11:22:49.600 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T11:22:49.600 DEBUG:teuthology.orchestra.run.trial046:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:22:49.602 DEBUG:teuthology.orchestra.run.trial086:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:22:49.616 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T11:22:49.627 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T11:22:49.628 DEBUG:teuthology.orchestra.run.trial046:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:22:49.657 DEBUG:teuthology.orchestra.run.trial086:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:22:49.672 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T11:22:49.828 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T11:22:49.848 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T11:22:49.848 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T11:22:49.848 DEBUG:teuthology.orchestra.run.trial046:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:22:49.848 DEBUG:teuthology.orchestra.run.trial086:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:22:49.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:22:49.863 DEBUG:teuthology.orchestra.run.trial046:> uname -r 2026-02-20T11:22:49.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:22:49.863 DEBUG:teuthology.orchestra.run.trial086:> uname -r 2026-02-20T11:22:49.918 INFO:teuthology.orchestra.run.trial046.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:22:49.918 INFO:teuthology.task.kernel:Running kernel on trial046: 5.14.0-681.el9.x86_64 2026-02-20T11:22:49.918 DEBUG:teuthology.orchestra.run.trial046:> sudo yum install -y kernel 2026-02-20T11:22:49.919 INFO:teuthology.orchestra.run.trial086.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:22:49.919 INFO:teuthology.task.kernel:Running kernel on trial086: 5.14.0-681.el9.x86_64 2026-02-20T11:22:49.919 DEBUG:teuthology.orchestra.run.trial086:> sudo yum install -y kernel 2026-02-20T11:22:51.666 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.9 MB 00:01 2026-02-20T11:22:51.790 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.9 MB 00:01 2026-02-20T11:22:54.935 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 9.8 MB/s | 27 MB 00:02 2026-02-20T11:22:55.273 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 27 MB 00:02 2026-02-20T11:22:58.307 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-20T11:22:59.108 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 7.8 MB 00:01 2026-02-20T11:22:59.523 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 20 kB 00:00 2026-02-20T11:23:00.027 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 20 kB 00:00 2026-02-20T11:23:00.102 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 39 MB/s | 20 MB 00:00 2026-02-20T11:23:00.641 INFO:teuthology.orchestra.run.trial046.stdout:Extra Packages for Enterprise Linux 37 MB/s | 20 MB 00:00 2026-02-20T11:23:03.330 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 456 kB/s | 50 kB 00:00 2026-02-20T11:23:03.839 INFO:teuthology.orchestra.run.trial046.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T11:23:04.336 INFO:teuthology.orchestra.run.trial086.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:23:04.337 INFO:teuthology.orchestra.run.trial086.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:23:04.356 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:23:04.356 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:23:04.356 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:23:04.379 DEBUG:teuthology.orchestra.run.trial086:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:23:04.682 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:23:03 AM UTC. 2026-02-20T11:23:04.764 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:23:04.765 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:23:04.765 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-20T11:23:04.765 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:23:04.765 INFO:teuthology.orchestra.run.trial086.stdout:Reinstalling: 2026-02-20T11:23:04.765 INFO:teuthology.orchestra.run.trial086.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:23:04.765 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:23:04.766 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:23:04.766 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:23:04.766 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:23:04.766 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 803 k 2026-02-20T11:23:04.766 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 0 2026-02-20T11:23:04.766 INFO:teuthology.orchestra.run.trial086.stderr:Operation aborted. 2026-02-20T11:23:04.784 INFO:teuthology.orchestra.run.trial086.stdout:Is this ok [y/N]: 2026-02-20T11:23:04.784 DEBUG:teuthology.orchestra.run.trial086:> sudo yum reinstall -y kernel || true 2026-02-20T11:23:04.842 INFO:teuthology.orchestra.run.trial046.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:23:04.842 INFO:teuthology.orchestra.run.trial046.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:23:04.861 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:23:04.862 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:23:04.862 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:23:04.886 DEBUG:teuthology.orchestra.run.trial046:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:23:05.084 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:23:03 AM UTC. 2026-02-20T11:23:05.166 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout:Reinstalling: 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 803 k 2026-02-20T11:23:05.167 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 0 2026-02-20T11:23:05.168 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:23:05.188 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:23:03 AM UTC. 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout:Reinstalling: 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:23:05.268 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:23:05.269 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 803 k 2026-02-20T11:23:05.269 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 0 2026-02-20T11:23:05.269 INFO:teuthology.orchestra.run.trial046.stderr:Operation aborted. 2026-02-20T11:23:05.289 INFO:teuthology.orchestra.run.trial046.stdout:Is this ok [y/N]: 2026-02-20T11:23:05.289 DEBUG:teuthology.orchestra.run.trial046:> sudo yum reinstall -y kernel || true 2026-02-20T11:23:05.439 INFO:teuthology.orchestra.run.trial086.stdout:kernel-5.14.0-681.el9.x86_64.rpm 3.7 MB/s | 803 kB 00:00 2026-02-20T11:23:05.439 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:23:05.439 INFO:teuthology.orchestra.run.trial086.stdout:Total 2.9 MB/s | 803 kB 00:00 2026-02-20T11:23:05.449 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:23:05.482 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:23:05.482 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:23:05.486 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:23:05.486 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:23:05.510 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:23:05.514 INFO:teuthology.orchestra.run.trial086.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:23:05.515 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:23:05.586 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:23:03 AM UTC. 2026-02-20T11:23:05.630 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:23:05.630 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:23:05.666 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout:Reinstalling: 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:23:05.667 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 803 k 2026-02-20T11:23:05.668 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 0 2026-02-20T11:23:05.668 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:23:05.687 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:23:05.687 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:23:05.687 INFO:teuthology.orchestra.run.trial086.stdout:Reinstalled: 2026-02-20T11:23:05.688 INFO:teuthology.orchestra.run.trial086.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:23:05.688 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:23:05.688 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:23:05.713 DEBUG:teuthology.orchestra.run.trial086:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:23:05.737 INFO:teuthology.orchestra.run.trial086.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:23:05.737 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:23:05.738 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:23:05.738 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-20T11:23:05.738 DEBUG:teuthology.orchestra.run.trial086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:23:05.803 INFO:teuthology.orchestra.run.trial086.stdout:ttyS1 2026-02-20T11:23:05.830 DEBUG:teuthology.parallel:result is None 2026-02-20T11:23:05.957 INFO:teuthology.orchestra.run.trial046.stdout:kernel-5.14.0-681.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2026-02-20T11:23:05.958 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:23:05.958 INFO:teuthology.orchestra.run.trial046.stdout:Total 2.7 MB/s | 803 kB 00:00 2026-02-20T11:23:05.968 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:23:06.002 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:23:06.002 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:23:06.006 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:23:06.006 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:23:06.031 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:23:06.034 INFO:teuthology.orchestra.run.trial046.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:23:06.035 INFO:teuthology.orchestra.run.trial046.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:23:06.140 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:23:06.140 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:23:06.197 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:23:06.197 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:23:06.197 INFO:teuthology.orchestra.run.trial046.stdout:Reinstalled: 2026-02-20T11:23:06.197 INFO:teuthology.orchestra.run.trial046.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:23:06.197 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:23:06.197 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:23:06.224 DEBUG:teuthology.orchestra.run.trial046:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:23:06.247 INFO:teuthology.orchestra.run.trial046.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:23:06.247 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:23:06.248 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:23:06.248 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T11:23:06.248 DEBUG:teuthology.orchestra.run.trial046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:23:06.310 INFO:teuthology.orchestra.run.trial046.stdout:ttyS1 2026-02-20T11:23:06.333 DEBUG:teuthology.parallel:result is None 2026-02-20T11:23:06.333 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T11:23:06.340 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T11:23:06.341 DEBUG:teuthology.orchestra.run.trial046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:23:06.375 DEBUG:teuthology.orchestra.run.trial086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:23:06.391 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T11:23:06.404 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T11:23:06.417 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T11:23:06.418 DEBUG:teuthology.orchestra.run.trial046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:23:06.432 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:23:06.454 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T11:23:06.465 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T11:23:06.466 DEBUG:teuthology.orchestra.run.trial046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:23:06.488 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:23:06.512 INFO:teuthology.orchestra.run.trial046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:23:06.513 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:23:06.521 INFO:teuthology.orchestra.run.trial046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:23:06.524 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:23:06.524 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T11:23:06.537 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T11:23:06.537 DEBUG:teuthology.orchestra.run.trial046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:23:06.566 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:23:06.591 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T11:23:06.616 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T11:23:06.616 DEBUG:teuthology.orchestra.run.trial046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:23:06.631 DEBUG:teuthology.orchestra.run.trial086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:23:06.649 DEBUG:teuthology.orchestra.run.trial046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:23:06.801 DEBUG:teuthology.orchestra.run.trial046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:23:06.827 DEBUG:teuthology.orchestra.run.trial046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:23:06.970 DEBUG:teuthology.orchestra.run.trial046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:23:06.994 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:23:06.995 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:23:07.059 DEBUG:teuthology.orchestra.run.trial086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:23:07.151 DEBUG:teuthology.orchestra.run.trial086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:23:07.174 DEBUG:teuthology.orchestra.run.trial086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:23:07.301 DEBUG:teuthology.orchestra.run.trial086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:23:07.324 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:23:07.324 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:23:07.386 DEBUG:teuthology.orchestra.run.trial046:> sudo service rsyslog restart 2026-02-20T11:23:07.388 DEBUG:teuthology.orchestra.run.trial086:> sudo service rsyslog restart 2026-02-20T11:23:07.415 INFO:teuthology.orchestra.run.trial046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:23:07.455 INFO:teuthology.orchestra.run.trial086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:23:07.879 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T11:23:07.891 INFO:teuthology.task.internal:Starting timer... 2026-02-20T11:23:07.891 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T11:23:07.908 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T11:23:07.921 DEBUG:teuthology.orchestra.run.trial046:> sudo service auditd rotate 2026-02-20T11:23:07.950 INFO:teuthology.orchestra.run.trial046.stdout:Rotating logs: 2026-02-20T11:23:07.951 DEBUG:teuthology.orchestra.run.trial086:> sudo service auditd rotate 2026-02-20T11:23:07.978 INFO:teuthology.orchestra.run.trial086.stdout:Rotating logs: 2026-02-20T11:23:07.980 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T11:23:07.980 DEBUG:teuthology.orchestra.run.trial046:> /usr/sbin/getenforce 2026-02-20T11:23:08.006 INFO:teuthology.orchestra.run.trial046.stdout:Permissive 2026-02-20T11:23:08.007 DEBUG:teuthology.orchestra.run.trial086:> /usr/sbin/getenforce 2026-02-20T11:23:08.035 INFO:teuthology.orchestra.run.trial086.stdout:Permissive 2026-02-20T11:23:08.035 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial046.front.sepia.ceph.com': 'permissive', 'ubuntu@trial086.front.sepia.ceph.com': 'permissive'} 2026-02-20T11:23:08.035 DEBUG:teuthology.orchestra.run.trial046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:23:08.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:23:08.073 DEBUG:teuthology.orchestra.run.trial086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:23:08.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:23:08.100 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T11:23:08.100 DEBUG:teuthology.orchestra.run.trial046:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:23:08.136 DEBUG:teuthology.orchestra.run.trial086:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:23:08.163 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T11:23:08.175 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T11:23:08.182 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T11:23:08.183 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial046.front.sepia.ceph.com,trial086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T11:25:59.767 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial046.front.sepia.ceph.com'), Remote(name='ubuntu@trial086.front.sepia.ceph.com')] 2026-02-20T11:25:59.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-20T11:25:59.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:25:59.883 DEBUG:teuthology.orchestra.run.trial046:> true 2026-02-20T11:25:59.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial046.front.sepia.ceph.com' 2026-02-20T11:25:59.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-20T11:25:59.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:26:00.046 DEBUG:teuthology.orchestra.run.trial086:> true 2026-02-20T11:26:00.129 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-20T11:26:00.129 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T11:26:00.139 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T11:26:00.139 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:26:00.139 DEBUG:teuthology.orchestra.run.trial046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:26:00.142 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:26:00.142 DEBUG:teuthology.orchestra.run.trial086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:26:00.168 INFO:teuthology.orchestra.run.trial046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:26:00.179 INFO:teuthology.orchestra.run.trial046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:26:00.197 INFO:teuthology.orchestra.run.trial086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:26:00.201 INFO:teuthology.orchestra.run.trial046.stderr:sudo: ntpd: command not found 2026-02-20T11:26:00.209 INFO:teuthology.orchestra.run.trial086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:26:00.210 INFO:teuthology.orchestra.run.trial046.stdout:506 Cannot talk to daemon 2026-02-20T11:26:00.222 INFO:teuthology.orchestra.run.trial046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:26:00.230 INFO:teuthology.orchestra.run.trial086.stderr:sudo: ntpd: command not found 2026-02-20T11:26:00.234 INFO:teuthology.orchestra.run.trial046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:26:00.240 INFO:teuthology.orchestra.run.trial086.stdout:506 Cannot talk to daemon 2026-02-20T11:26:00.251 INFO:teuthology.orchestra.run.trial086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:26:00.263 INFO:teuthology.orchestra.run.trial086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:26:00.282 INFO:teuthology.orchestra.run.trial046.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:26:00.314 INFO:teuthology.orchestra.run.trial086.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:26:00.678 INFO:teuthology.orchestra.run.trial086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:26:00.678 INFO:teuthology.orchestra.run.trial086.stdout:=============================================================================== 2026-02-20T11:26:00.678 INFO:teuthology.orchestra.run.trial086.stdout:^? white.web-ster.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:00.678 INFO:teuthology.orchestra.run.trial086.stdout:^? 172-233-157-223.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:00.678 INFO:teuthology.orchestra.run.trial086.stdout:^? 216-144-228-179-host.col> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:00.678 INFO:teuthology.orchestra.run.trial086.stdout:^? 155.248.196.28 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:03.302 INFO:teuthology.orchestra.run.trial046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:26:03.303 INFO:teuthology.orchestra.run.trial046.stdout:=============================================================================== 2026-02-20T11:26:03.303 INFO:teuthology.orchestra.run.trial046.stdout:^? 45-79-189-79.ip.linodeus> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:03.303 INFO:teuthology.orchestra.run.trial046.stdout:^? pool-138-89-14-60.mad.ea> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:03.303 INFO:teuthology.orchestra.run.trial046.stdout:^? 170-187-142-180.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:03.303 INFO:teuthology.orchestra.run.trial046.stdout:^? 172-238-164-57.ip.linode> 4 6 3 1 -4994us[-4994us] +/- 36ms 2026-02-20T11:26:03.304 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:26:03.318 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:26:03.318 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:26:03.318 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:26:03.318 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:26:03.327 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:26:03.327 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-20T11:26:03.328 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:26:03.329 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:26:03.331 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:26:03.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:26:03.605 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:26:03.605 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:26:03.616 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:26:03.616 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:26:03.883 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:26:03.883 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:26:03.883 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:26:03.909 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:26:03.910 DEBUG:teuthology.orchestra.run.trial046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:26:03.917 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:26:03.917 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:26:03.917 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:26:03.944 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:26:03.944 DEBUG:teuthology.orchestra.run.trial086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:26:03.975 DEBUG:teuthology.orchestra.run.trial046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:26:04.009 DEBUG:teuthology.orchestra.run.trial086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:26:04.050 DEBUG:teuthology.orchestra.run.trial046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:26:04.084 DEBUG:teuthology.orchestra.run.trial086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:26:04.114 INFO:teuthology.orchestra.run.trial046.stdout:check_obsoletes = 1 2026-02-20T11:26:04.116 DEBUG:teuthology.orchestra.run.trial046:> sudo yum clean all 2026-02-20T11:26:04.149 INFO:teuthology.orchestra.run.trial086.stdout:check_obsoletes = 1 2026-02-20T11:26:04.151 DEBUG:teuthology.orchestra.run.trial086:> sudo yum clean all 2026-02-20T11:26:04.275 INFO:teuthology.orchestra.run.trial046.stdout:41 files removed 2026-02-20T11:26:04.290 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-radosgw 2026-02-20T11:26:04.309 INFO:teuthology.orchestra.run.trial086.stdout:41 files removed 2026-02-20T11:26:04.323 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-radosgw 2026-02-20T11:26:04.926 INFO:teuthology.orchestra.run.trial046.stdout:ceph packages for x86_64 190 kB/s | 94 kB 00:00 2026-02-20T11:26:04.958 INFO:teuthology.orchestra.run.trial086.stdout:ceph packages for x86_64 191 kB/s | 94 kB 00:00 2026-02-20T11:26:05.432 INFO:teuthology.orchestra.run.trial046.stdout:ceph noarch packages 51 kB/s | 24 kB 00:00 2026-02-20T11:26:05.467 INFO:teuthology.orchestra.run.trial086.stdout:ceph noarch packages 51 kB/s | 24 kB 00:00 2026-02-20T11:26:05.921 INFO:teuthology.orchestra.run.trial046.stdout:ceph source packages 4.4 kB/s | 2.1 kB 00:00 2026-02-20T11:26:05.960 INFO:teuthology.orchestra.run.trial086.stdout:ceph source packages 4.4 kB/s | 2.1 kB 00:00 2026-02-20T11:26:06.788 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-20T11:26:06.827 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-20T11:26:09.465 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-20T11:26:10.199 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 27 MB 00:02 2026-02-20T11:26:12.737 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 7.8 MB 00:00 2026-02-20T11:26:13.649 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 104 kB/s | 20 kB 00:00 2026-02-20T11:26:13.858 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 7.8 MB 00:01 2026-02-20T11:26:13.952 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 85 MB/s | 20 MB 00:00 2026-02-20T11:26:15.011 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 20 kB 00:00 2026-02-20T11:26:15.266 INFO:teuthology.orchestra.run.trial046.stdout:Extra Packages for Enterprise Linux 105 MB/s | 20 MB 00:00 2026-02-20T11:26:17.233 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 514 kB/s | 50 kB 00:00 2026-02-20T11:26:18.425 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:26:18.426 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:26:18.426 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout:Upgrading: 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:26:18.427 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:26:18.428 INFO:teuthology.orchestra.run.trial086.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:26:18.429 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:26:18.430 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:26:18.431 INFO:teuthology.orchestra.run.trial086.stdout:Install 35 Packages 2026-02-20T11:26:18.431 INFO:teuthology.orchestra.run.trial086.stdout:Upgrade 2 Packages 2026-02-20T11:26:18.431 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:18.431 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 61 M 2026-02-20T11:26:18.431 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:26:18.504 INFO:teuthology.orchestra.run.trial046.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-20T11:26:19.692 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:26:19.693 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout:Upgrading: 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:26:19.694 INFO:teuthology.orchestra.run.trial046.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:26:19.695 INFO:teuthology.orchestra.run.trial046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:26:19.696 INFO:teuthology.orchestra.run.trial046.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout:Installing weak dependencies: 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:19.697 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:26:19.698 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:26:19.698 INFO:teuthology.orchestra.run.trial046.stdout:Install 35 Packages 2026-02-20T11:26:19.698 INFO:teuthology.orchestra.run.trial046.stdout:Upgrade 2 Packages 2026-02-20T11:26:19.698 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:19.698 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 61 M 2026-02-20T11:26:19.699 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:26:20.503 INFO:teuthology.orchestra.run.trial086.stdout:(1/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x86 3.2 MB/s | 5.1 MB 00:01 2026-02-20T11:26:20.559 INFO:teuthology.orchestra.run.trial086.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 456 kB/s | 25 kB 00:00 2026-02-20T11:26:20.614 INFO:teuthology.orchestra.run.trial086.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 666 kB/s | 37 kB 00:00 2026-02-20T11:26:20.672 INFO:teuthology.orchestra.run.trial086.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 438 kB/s | 26 kB 00:00 2026-02-20T11:26:20.941 INFO:teuthology.orchestra.run.trial086.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 3.1 MB/s | 860 kB 00:00 2026-02-20T11:26:21.006 INFO:teuthology.orchestra.run.trial086.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 3.9 MB/s | 263 kB 00:00 2026-02-20T11:26:21.918 INFO:teuthology.orchestra.run.trial046.stdout:(1/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x86 3.1 MB/s | 5.1 MB 00:01 2026-02-20T11:26:21.976 INFO:teuthology.orchestra.run.trial046.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 437 kB/s | 25 kB 00:00 2026-02-20T11:26:22.034 INFO:teuthology.orchestra.run.trial046.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 634 kB/s | 37 kB 00:00 2026-02-20T11:26:22.093 INFO:teuthology.orchestra.run.trial046.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 435 kB/s | 26 kB 00:00 2026-02-20T11:26:22.345 INFO:teuthology.orchestra.run.trial046.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 3.4 MB/s | 860 kB 00:00 2026-02-20T11:26:22.410 INFO:teuthology.orchestra.run.trial046.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 3.9 MB/s | 263 kB 00:00 2026-02-20T11:26:22.671 INFO:teuthology.orchestra.run.trial086.stdout:(7/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_6 3.4 MB/s | 5.6 MB 00:01 2026-02-20T11:26:22.737 INFO:teuthology.orchestra.run.trial086.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 688 kB/s | 45 kB 00:00 2026-02-20T11:26:22.806 INFO:teuthology.orchestra.run.trial086.stdout:(9/37): python3-ceph-common-20.3.0-5357.g0c3148 2.6 MB/s | 185 kB 00:00 2026-02-20T11:26:22.874 INFO:teuthology.orchestra.run.trial086.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 2.9 MB/s | 204 kB 00:00 2026-02-20T11:26:23.080 INFO:teuthology.orchestra.run.trial086.stdout:(11/37): python3-rados-20.3.0-5357.g0c3148ca.el 1.5 MB/s | 324 kB 00:00 2026-02-20T11:26:23.209 INFO:teuthology.orchestra.run.trial086.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 2.3 MB/s | 305 kB 00:00 2026-02-20T11:26:23.265 INFO:teuthology.orchestra.run.trial086.stdout:(13/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 1.8 MB/s | 100 kB 00:00 2026-02-20T11:26:23.593 INFO:teuthology.orchestra.run.trial086.stdout:(14/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9 2.4 MB/s | 11 MB 00:04 2026-02-20T11:26:23.699 INFO:teuthology.orchestra.run.trial046.stdout:(7/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_6 4.4 MB/s | 5.6 MB 00:01 2026-02-20T11:26:23.757 INFO:teuthology.orchestra.run.trial046.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 779 kB/s | 45 kB 00:00 2026-02-20T11:26:23.820 INFO:teuthology.orchestra.run.trial046.stdout:(9/37): python3-ceph-common-20.3.0-5357.g0c3148 2.9 MB/s | 185 kB 00:00 2026-02-20T11:26:23.883 INFO:teuthology.orchestra.run.trial046.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 3.1 MB/s | 204 kB 00:00 2026-02-20T11:26:23.891 INFO:teuthology.orchestra.run.trial086.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 53 kB/s | 33 kB 00:00 2026-02-20T11:26:24.005 INFO:teuthology.orchestra.run.trial046.stdout:(11/37): python3-rados-20.3.0-5357.g0c3148ca.el 2.6 MB/s | 324 kB 00:00 2026-02-20T11:26:24.072 INFO:teuthology.orchestra.run.trial046.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 4.5 MB/s | 305 kB 00:00 2026-02-20T11:26:24.131 INFO:teuthology.orchestra.run.trial046.stdout:(13/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 1.7 MB/s | 100 kB 00:00 2026-02-20T11:26:24.156 INFO:teuthology.orchestra.run.trial086.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 351 kB/s | 93 kB 00:00 2026-02-20T11:26:24.406 INFO:teuthology.orchestra.run.trial046.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 120 kB/s | 33 kB 00:00 2026-02-20T11:26:24.410 INFO:teuthology.orchestra.run.trial086.stdout:(17/37): ceph-common-20.3.0-5357.g0c3148ca.el9. 3.8 MB/s | 21 MB 00:05 2026-02-20T11:26:24.561 INFO:teuthology.orchestra.run.trial086.stdout:(18/37): nvme-cli-2.16-1.el9.x86_64.rpm 1.2 MB/s | 1.2 MB 00:00 2026-02-20T11:26:24.860 INFO:teuthology.orchestra.run.trial086.stdout:(19/37): boost-program-options-1.75.0-13.el9.x8 148 kB/s | 104 kB 00:00 2026-02-20T11:26:24.918 INFO:teuthology.orchestra.run.trial046.stdout:(15/37): nvme-cli-2.16-1.el9.x86_64.rpm 2.3 MB/s | 1.2 MB 00:00 2026-02-20T11:26:25.003 INFO:teuthology.orchestra.run.trial046.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 1.1 MB/s | 93 kB 00:00 2026-02-20T11:26:25.090 INFO:teuthology.orchestra.run.trial046.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 1.2 MB/s | 104 kB 00:00 2026-02-20T11:26:25.155 INFO:teuthology.orchestra.run.trial086.stdout:(20/37): libnbd-1.20.3-4.el9.x86_64.rpm 221 kB/s | 164 kB 00:00 2026-02-20T11:26:25.178 INFO:teuthology.orchestra.run.trial046.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 1.8 MB/s | 164 kB 00:00 2026-02-20T11:26:25.266 INFO:teuthology.orchestra.run.trial046.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.8 MB/s | 160 kB 00:00 2026-02-20T11:26:25.278 INFO:teuthology.orchestra.run.trial086.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 223 kB/s | 160 kB 00:00 2026-02-20T11:26:25.350 INFO:teuthology.orchestra.run.trial046.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 543 kB/s | 45 kB 00:00 2026-02-20T11:26:25.462 INFO:teuthology.orchestra.run.trial086.stdout:(22/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2026-02-20T11:26:25.462 INFO:teuthology.orchestra.run.trial046.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 5.7 MB/s | 662 kB 00:00 2026-02-20T11:26:25.557 INFO:teuthology.orchestra.run.trial046.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 292 kB 00:00 2026-02-20T11:26:25.650 INFO:teuthology.orchestra.run.trial046.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 2.5 MB/s | 240 kB 00:00 2026-02-20T11:26:25.733 INFO:teuthology.orchestra.run.trial046.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 449 kB/s | 37 kB 00:00 2026-02-20T11:26:25.816 INFO:teuthology.orchestra.run.trial046.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 791 kB/s | 66 kB 00:00 2026-02-20T11:26:25.937 INFO:teuthology.orchestra.run.trial046.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.5 MB/s | 308 kB 00:00 2026-02-20T11:26:25.962 INFO:teuthology.orchestra.run.trial046.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 178 MB/s | 4.4 MB 00:00 2026-02-20T11:26:25.966 INFO:teuthology.orchestra.run.trial046.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 6.7 MB/s | 25 kB 00:00 2026-02-20T11:26:25.969 INFO:teuthology.orchestra.run.trial046.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 14 MB/s | 49 kB 00:00 2026-02-20T11:26:25.973 INFO:teuthology.orchestra.run.trial046.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 20 MB/s | 67 kB 00:00 2026-02-20T11:26:25.979 INFO:teuthology.orchestra.run.trial046.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 147 MB/s | 838 kB 00:00 2026-02-20T11:26:25.982 INFO:teuthology.orchestra.run.trial046.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 51 MB/s | 191 kB 00:00 2026-02-20T11:26:25.990 INFO:teuthology.orchestra.run.trial046.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 199 MB/s | 1.6 MB 00:00 2026-02-20T11:26:26.028 INFO:teuthology.orchestra.run.trial086.stdout:(23/37): librdkafka-1.6.1-102.el9.x86_64.rpm 759 kB/s | 662 kB 00:00 2026-02-20T11:26:26.062 INFO:teuthology.orchestra.run.trial086.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 373 kB/s | 292 kB 00:00 2026-02-20T11:26:26.242 INFO:teuthology.orchestra.run.trial086.stdout:(25/37): qatlib-25.08.0-2.el9.x86_64.rpm 307 kB/s | 240 kB 00:00 2026-02-20T11:26:26.563 INFO:teuthology.orchestra.run.trial086.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 956 kB/s | 308 kB 00:00 2026-02-20T11:26:26.600 INFO:teuthology.orchestra.run.trial086.stdout:(27/37): qatlib-service-25.08.0-2.el9.x86_64.rp 65 kB/s | 37 kB 00:00 2026-02-20T11:26:26.689 INFO:teuthology.orchestra.run.trial086.stdout:(28/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 106 kB/s | 66 kB 00:00 2026-02-20T11:26:26.723 INFO:teuthology.orchestra.run.trial086.stdout:(29/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 201 kB/s | 25 kB 00:00 2026-02-20T11:26:26.730 INFO:teuthology.orchestra.run.trial086.stdout:(30/37): libarrow-9.0.0-15.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2026-02-20T11:26:26.786 INFO:teuthology.orchestra.run.trial086.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 15 MB/s | 838 kB 00:00 2026-02-20T11:26:26.806 INFO:teuthology.orchestra.run.trial086.stdout:(32/37): libunwind-1.6.2-1.el9.x86_64.rpm 813 kB/s | 67 kB 00:00 2026-02-20T11:26:26.828 INFO:teuthology.orchestra.run.trial086.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2026-02-20T11:26:26.851 INFO:teuthology.orchestra.run.trial086.stdout:(34/37): liboath-2.6.12-1.el9.x86_64.rpm 301 kB/s | 49 kB 00:00 2026-02-20T11:26:26.960 INFO:teuthology.orchestra.run.trial046.stdout:(34/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 3.4 MB/s | 3.3 MB 00:00 2026-02-20T11:26:27.012 INFO:teuthology.orchestra.run.trial086.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 7.7 MB/s | 1.6 MB 00:00 2026-02-20T11:26:27.310 INFO:teuthology.orchestra.run.trial046.stdout:(35/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9 1.6 MB/s | 11 MB 00:07 2026-02-20T11:26:27.547 INFO:teuthology.orchestra.run.trial046.stdout:(36/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 4.6 MB/s | 2.7 MB 00:00 2026-02-20T11:26:31.077 INFO:teuthology.orchestra.run.trial046.stdout:(37/37): ceph-common-20.3.0-5357.g0c3148ca.el9. 1.9 MB/s | 21 MB 00:10 2026-02-20T11:26:31.080 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:26:31.080 INFO:teuthology.orchestra.run.trial046.stdout:Total 5.4 MB/s | 61 MB 00:11 2026-02-20T11:26:31.178 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:26:31.197 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:26:31.197 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:26:31.447 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:26:31.447 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:26:31.587 INFO:teuthology.orchestra.run.trial086.stdout:(36/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 582 kB/s | 2.7 MB 00:04 2026-02-20T11:26:31.738 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:26:31.837 INFO:teuthology.orchestra.run.trial086.stdout:(37/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 671 kB/s | 3.3 MB 00:05 2026-02-20T11:26:31.840 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:26:31.840 INFO:teuthology.orchestra.run.trial086.stdout:Total 4.6 MB/s | 61 MB 00:13 2026-02-20T11:26:31.881 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:26:31.885 INFO:teuthology.orchestra.run.trial046.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:26:31.932 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:26:31.933 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:26:31.939 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:26:31.945 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:26:31.947 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:26:31.948 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:26:31.957 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:26:31.957 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:26:31.975 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:26:31.977 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:26:31.985 INFO:teuthology.orchestra.run.trial046.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:26:31.988 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:26:31.993 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:26:31.997 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:26:32.008 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:26:32.021 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:26:32.022 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:26:32.042 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:26:32.045 INFO:teuthology.orchestra.run.trial046.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:26:32.075 INFO:teuthology.orchestra.run.trial046.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:26:32.079 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:26:32.085 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:26:32.087 INFO:teuthology.orchestra.run.trial046.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:26:32.092 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:26:32.207 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:26:32.207 INFO:teuthology.orchestra.run.trial046.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:26:32.208 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:26:32.208 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:26:32.236 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:26:32.238 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:26:32.245 INFO:teuthology.orchestra.run.trial046.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:26:32.491 INFO:teuthology.orchestra.run.trial046.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:26:32.493 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:26:32.497 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:26:32.511 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:26:32.515 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:26:32.520 INFO:teuthology.orchestra.run.trial046.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:26:32.523 INFO:teuthology.orchestra.run.trial046.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:26:32.524 INFO:teuthology.orchestra.run.trial046.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:26:32.543 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:26:32.647 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:26:32.651 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:26:32.656 INFO:teuthology.orchestra.run.trial046.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:26:32.658 INFO:teuthology.orchestra.run.trial046.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:26:32.700 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:26:32.701 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:26:32.714 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:26:32.716 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:26:32.717 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:26:32.744 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:26:32.748 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:26:32.757 INFO:teuthology.orchestra.run.trial086.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:26:32.759 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:26:32.762 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:26:32.766 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:26:32.777 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:26:32.790 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:26:32.791 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:26:32.815 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:26:32.819 INFO:teuthology.orchestra.run.trial086.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:26:32.853 INFO:teuthology.orchestra.run.trial086.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:26:32.858 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:26:32.864 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:26:32.867 INFO:teuthology.orchestra.run.trial086.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:26:32.872 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:26:32.936 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:26:32.936 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:26:32.936 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:32.981 INFO:teuthology.orchestra.run.trial046.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:26:32.983 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:26:32.990 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:26:32.991 INFO:teuthology.orchestra.run.trial086.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:26:33.018 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:26:33.020 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:26:33.026 INFO:teuthology.orchestra.run.trial086.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:26:33.285 INFO:teuthology.orchestra.run.trial086.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:26:33.287 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:26:33.302 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:26:33.307 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:26:33.313 INFO:teuthology.orchestra.run.trial086.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:26:33.315 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:26:33.316 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:26:33.334 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:26:33.449 INFO:teuthology.orchestra.run.trial086.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:26:33.451 INFO:teuthology.orchestra.run.trial086.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:26:33.721 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:26:33.722 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:26:33.722 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:33.769 INFO:teuthology.orchestra.run.trial086.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:26:33.771 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:26:33.927 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:26:33.929 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:26:34.188 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:26:34.192 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:26:34.230 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:26:34.231 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:26:34.231 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:26:34.231 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:34.234 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:26:34.753 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:26:34.756 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:26:35.028 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:26:35.032 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:26:35.069 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:26:35.069 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:26:35.069 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:26:35.069 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:35.072 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:26:38.723 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:26:38.723 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /sys 2026-02-20T11:26:38.723 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /proc 2026-02-20T11:26:38.724 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /mnt 2026-02-20T11:26:38.724 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /var/tmp 2026-02-20T11:26:38.724 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /home 2026-02-20T11:26:38.724 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /root 2026-02-20T11:26:38.724 INFO:teuthology.orchestra.run.trial046.stdout:skipping the directory /tmp 2026-02-20T11:26:38.724 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:39.213 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:26:39.238 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:26:39.238 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:26:39.238 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:26:39.238 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:26:39.238 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:26:39.238 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:39.240 INFO:teuthology.orchestra.run.trial046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:26:39.252 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:26:39.252 INFO:teuthology.orchestra.run.trial046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:26:39.307 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:26:39.307 INFO:teuthology.orchestra.run.trial046.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:26:39.307 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:39.621 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:26:39.622 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:26:39.622 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:26:39.622 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:26:39.622 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:26:39.622 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:26:39.622 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:26:39.622 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:26:39.622 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:26:39.623 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:26:39.624 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:26:39.625 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:26:39.625 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:26:39.625 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:26:39.625 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:26:39.648 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:26:39.649 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /sys 2026-02-20T11:26:39.649 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /proc 2026-02-20T11:26:39.649 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /mnt 2026-02-20T11:26:39.649 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /var/tmp 2026-02-20T11:26:39.649 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /home 2026-02-20T11:26:39.649 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /root 2026-02-20T11:26:39.649 INFO:teuthology.orchestra.run.trial086.stdout:skipping the directory /tmp 2026-02-20T11:26:39.649 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:39.684 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:26:39.684 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:39.684 INFO:teuthology.orchestra.run.trial046.stdout:Upgraded: 2026-02-20T11:26:39.684 INFO:teuthology.orchestra.run.trial046.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:26:39.685 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:26:39.686 INFO:teuthology.orchestra.run.trial046.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:26:39.687 INFO:teuthology.orchestra.run.trial046.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:26:39.688 INFO:teuthology.orchestra.run.trial046.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:26:39.688 INFO:teuthology.orchestra.run.trial046.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:26:39.688 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:39.688 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:26:39.726 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-test 2026-02-20T11:26:40.041 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:22 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:26:40.124 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:26:40.125 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:26:40.125 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-20T11:26:40.125 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:26:40.125 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:26:40.125 INFO:teuthology.orchestra.run.trial046.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:26:40.125 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-20T11:26:40.125 INFO:teuthology.orchestra.run.trial046.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:26:40.125 INFO:teuthology.orchestra.run.trial046.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:26:40.125 INFO:teuthology.orchestra.run.trial046.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:26:40.126 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:26:40.127 INFO:teuthology.orchestra.run.trial046.stdout:Install 12 Packages 2026-02-20T11:26:40.127 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:26:40.127 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 132 M 2026-02-20T11:26:40.127 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 989 M 2026-02-20T11:26:40.127 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:26:40.152 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:26:40.175 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:26:40.175 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:26:40.175 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:26:40.175 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:26:40.176 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:26:40.176 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:40.177 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:26:40.188 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:26:40.188 INFO:teuthology.orchestra.run.trial086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:26:40.242 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:26:40.242 INFO:teuthology.orchestra.run.trial086.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:26:40.243 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:40.547 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:26:40.548 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:26:40.549 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:26:40.550 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:26:40.550 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:26:40.550 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:26:40.550 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:26:40.550 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:26:40.550 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:26:40.550 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:26:40.550 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:26:40.611 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:26:40.611 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:40.611 INFO:teuthology.orchestra.run.trial086.stdout:Upgraded: 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.612 INFO:teuthology.orchestra.run.trial086.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.613 INFO:teuthology.orchestra.run.trial086.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.614 INFO:teuthology.orchestra.run.trial086.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.614 INFO:teuthology.orchestra.run.trial086.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:26:40.614 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:26:40.614 INFO:teuthology.orchestra.run.trial086.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:26:40.614 INFO:teuthology.orchestra.run.trial086.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:26:40.614 INFO:teuthology.orchestra.run.trial086.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:26:40.614 INFO:teuthology.orchestra.run.trial086.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:26:40.614 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:40.614 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:26:40.653 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-test 2026-02-20T11:26:40.770 INFO:teuthology.orchestra.run.trial046.stdout:(1/12): libcephsqlite-20.3.0-5357.g0c3148ca.el9 344 kB/s | 153 kB 00:00 2026-02-20T11:26:40.971 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:23 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:26:41.053 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:26:41.054 INFO:teuthology.orchestra.run.trial086.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout:Install 12 Packages 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 132 M 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 989 M 2026-02-20T11:26:41.055 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:26:41.313 INFO:teuthology.orchestra.run.trial046.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2026-02-20T11:26:41.332 INFO:teuthology.orchestra.run.trial046.stdout:(3/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.1 MB/s | 2.1 MB 00:01 2026-02-20T11:26:41.967 INFO:teuthology.orchestra.run.trial046.stdout:(4/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 144 kB/s | 94 kB 00:00 2026-02-20T11:26:41.991 INFO:teuthology.orchestra.run.trial086.stdout:(1/12): libcephsqlite-20.3.0-5357.g0c3148ca.el9 217 kB/s | 153 kB 00:00 2026-02-20T11:26:42.022 INFO:teuthology.orchestra.run.trial046.stdout:(5/12): libasan8-15.2.1-7.el9.x86_64.rpm 761 kB/s | 525 kB 00:00 2026-02-20T11:26:42.127 INFO:teuthology.orchestra.run.trial046.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 2.2 MB/s | 233 kB 00:00 2026-02-20T11:26:42.296 INFO:teuthology.orchestra.run.trial086.stdout:(2/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.1 MB/s | 2.1 MB 00:01 2026-02-20T11:26:42.319 INFO:teuthology.orchestra.run.trial046.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2026-02-20T11:26:42.412 INFO:teuthology.orchestra.run.trial046.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 3.2 MB/s | 303 kB 00:00 2026-02-20T11:26:42.449 INFO:teuthology.orchestra.run.trial046.stdout:(9/12): libubsan-11.5.0-14.el9.x86_64.rpm 365 kB/s | 176 kB 00:00 2026-02-20T11:26:42.494 INFO:teuthology.orchestra.run.trial046.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 771 kB/s | 64 kB 00:00 2026-02-20T11:26:42.535 INFO:teuthology.orchestra.run.trial086.stdout:(3/12): libatomic-11.5.0-14.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2026-02-20T11:26:42.641 INFO:teuthology.orchestra.run.trial086.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 4.8 MB/s | 525 kB 00:00 2026-02-20T11:26:42.643 INFO:teuthology.orchestra.run.trial046.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 627 kB/s | 122 kB 00:00 2026-02-20T11:26:42.664 INFO:teuthology.orchestra.run.trial086.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 7.3 MB/s | 176 kB 00:00 2026-02-20T11:26:42.688 INFO:teuthology.orchestra.run.trial086.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 9.7 MB/s | 233 kB 00:00 2026-02-20T11:26:42.740 INFO:teuthology.orchestra.run.trial086.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 19 MB/s | 1.0 MB 00:00 2026-02-20T11:26:42.764 INFO:teuthology.orchestra.run.trial086.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-20T11:26:42.786 INFO:teuthology.orchestra.run.trial086.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-20T11:26:42.815 INFO:teuthology.orchestra.run.trial086.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 4.1 MB/s | 122 kB 00:00 2026-02-20T11:26:42.954 INFO:teuthology.orchestra.run.trial086.stdout:(11/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 143 kB/s | 94 kB 00:00 2026-02-20T11:27:10.770 INFO:teuthology.orchestra.run.trial046.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 4.2 MB/s | 127 MB 00:30 2026-02-20T11:27:10.771 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:27:10.772 INFO:teuthology.orchestra.run.trial046.stdout:Total 4.3 MB/s | 132 MB 00:30 2026-02-20T11:27:10.849 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:27:10.861 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:27:10.861 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:27:11.292 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:27:11.292 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:27:11.749 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:27:11.758 INFO:teuthology.orchestra.run.trial046.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:27:11.766 INFO:teuthology.orchestra.run.trial046.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:27:11.771 INFO:teuthology.orchestra.run.trial046.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:27:11.775 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:27:11.778 INFO:teuthology.orchestra.run.trial046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:27:11.782 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:27:11.783 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:27:11.801 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:27:11.804 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:27:11.814 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:27:11.823 INFO:teuthology.orchestra.run.trial046.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:27:11.823 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:27:18.776 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:27:18.793 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:27:19.596 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:27:19.597 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:27:19.597 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:27:19.597 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:27:19.597 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:27:19.597 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:27:19.597 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:27:19.597 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:27:19.597 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:27:19.597 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:27:19.598 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:27:19.598 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:27:19.650 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:27:19.650 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:27:19.650 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:27:19.650 INFO:teuthology.orchestra.run.trial046.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:19.650 INFO:teuthology.orchestra.run.trial046.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:27:19.650 INFO:teuthology.orchestra.run.trial046.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:27:19.650 INFO:teuthology.orchestra.run.trial046.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:27:19.650 INFO:teuthology.orchestra.run.trial046.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:19.650 INFO:teuthology.orchestra.run.trial046.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:27:19.651 INFO:teuthology.orchestra.run.trial046.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:27:19.651 INFO:teuthology.orchestra.run.trial046.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:27:19.651 INFO:teuthology.orchestra.run.trial046.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:27:19.651 INFO:teuthology.orchestra.run.trial046.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:27:19.651 INFO:teuthology.orchestra.run.trial046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:27:19.651 INFO:teuthology.orchestra.run.trial046.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:27:19.651 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:27:19.651 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:27:19.692 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph 2026-02-20T11:27:19.999 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:01:01 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:27:20.086 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:27:20.089 INFO:teuthology.orchestra.run.trial046.stdout:======================================================================================= 2026-02-20T11:27:20.089 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repository Size 2026-02-20T11:27:20.089 INFO:teuthology.orchestra.run.trial046.stdout:======================================================================================= 2026-02-20T11:27:20.089 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:27:20.089 INFO:teuthology.orchestra.run.trial046.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:27:20.089 INFO:teuthology.orchestra.run.trial046.stdout:Installing dependencies: 2026-02-20T11:27:20.090 INFO:teuthology.orchestra.run.trial046.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:27:20.090 INFO:teuthology.orchestra.run.trial046.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:27:20.090 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:27:20.090 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:27:20.090 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:27:20.090 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:27:20.090 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:27:20.090 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:27:20.090 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:27:20.091 INFO:teuthology.orchestra.run.trial046.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:27:20.092 INFO:teuthology.orchestra.run.trial046.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:27:20.093 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:27:20.094 INFO:teuthology.orchestra.run.trial046.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:27:20.095 INFO:teuthology.orchestra.run.trial046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:27:20.096 INFO:teuthology.orchestra.run.trial046.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:27:20.097 INFO:teuthology.orchestra.run.trial046.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout:Installing weak dependencies: 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:27:20.098 INFO:teuthology.orchestra.run.trial046.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:27:20.099 INFO:teuthology.orchestra.run.trial046.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:27:20.099 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:27:20.099 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:27:20.099 INFO:teuthology.orchestra.run.trial046.stdout:======================================================================================= 2026-02-20T11:27:20.099 INFO:teuthology.orchestra.run.trial046.stdout:Install 96 Packages 2026-02-20T11:27:20.099 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:27:20.100 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 226 M 2026-02-20T11:27:20.100 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 1.5 G 2026-02-20T11:27:20.100 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:27:20.928 INFO:teuthology.orchestra.run.trial046.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2026-02-20T11:27:21.465 INFO:teuthology.orchestra.run.trial046.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 1.1 MB/s | 937 kB 00:00 2026-02-20T11:27:21.530 INFO:teuthology.orchestra.run.trial046.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 2.4 MB/s | 163 kB 00:00 2026-02-20T11:27:21.789 INFO:teuthology.orchestra.run.trial046.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 1.8 MB/s | 2.0 MB 00:01 2026-02-20T11:27:24.076 INFO:teuthology.orchestra.run.trial046.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 1.5 MB/s | 4.9 MB 00:03 2026-02-20T11:27:24.140 INFO:teuthology.orchestra.run.trial046.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 905 kB/s | 57 kB 00:00 2026-02-20T11:27:24.347 INFO:teuthology.orchestra.run.trial046.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 886 kB/s | 184 kB 00:00 2026-02-20T11:27:24.897 INFO:teuthology.orchestra.run.trial046.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 4.4 MB/s | 15 MB 00:03 2026-02-20T11:27:26.388 INFO:teuthology.orchestra.run.trial046.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 5.0 MB/s | 7.4 MB 00:01 2026-02-20T11:27:26.452 INFO:teuthology.orchestra.run.trial046.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 349 kB/s | 22 kB 00:00 2026-02-20T11:27:26.522 INFO:teuthology.orchestra.run.trial046.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 4.1 MB/s | 297 kB 00:00 2026-02-20T11:27:26.588 INFO:teuthology.orchestra.run.trial046.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 768 kB/s | 50 kB 00:00 2026-02-20T11:27:26.653 INFO:teuthology.orchestra.run.trial046.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 266 kB/s | 17 kB 00:00 2026-02-20T11:27:26.725 INFO:teuthology.orchestra.run.trial046.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 4.1 MB/s | 301 kB 00:00 2026-02-20T11:27:26.990 INFO:teuthology.orchestra.run.trial046.stdout:(15/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 3.8 MB/s | 1.0 MB 00:00 2026-02-20T11:27:27.980 INFO:teuthology.orchestra.run.trial046.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 354 kB/s | 351 kB 00:00 2026-02-20T11:27:28.088 INFO:teuthology.orchestra.run.trial046.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 378 kB/s | 40 kB 00:00 2026-02-20T11:27:28.281 INFO:teuthology.orchestra.run.trial046.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 373 kB/s | 72 kB 00:00 2026-02-20T11:27:29.340 INFO:teuthology.orchestra.run.trial046.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 750 kB/s | 794 kB 00:01 2026-02-20T11:27:29.620 INFO:teuthology.orchestra.run.trial046.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 658 kB/s | 184 kB 00:00 2026-02-20T11:27:29.988 INFO:teuthology.orchestra.run.trial046.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 689 kB/s | 253 kB 00:00 2026-02-20T11:27:30.272 INFO:teuthology.orchestra.run.trial046.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 4.4 MB/s | 1.2 MB 00:00 2026-02-20T11:27:30.380 INFO:teuthology.orchestra.run.trial046.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 983 kB/s | 106 kB 00:00 2026-02-20T11:27:30.488 INFO:teuthology.orchestra.run.trial046.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 1.2 MB/s | 135 kB 00:00 2026-02-20T11:27:30.596 INFO:teuthology.orchestra.run.trial046.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 1.4 MB/s | 150 kB 00:00 2026-02-20T11:27:30.705 INFO:teuthology.orchestra.run.trial046.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 1.1 MB/s | 126 kB 00:00 2026-02-20T11:27:30.813 INFO:teuthology.orchestra.run.trial046.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 2.0 MB/s | 218 kB 00:00 2026-02-20T11:27:30.901 INFO:teuthology.orchestra.run.trial086.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 2.6 MB/s | 127 MB 00:49 2026-02-20T11:27:30.903 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:27:30.904 INFO:teuthology.orchestra.run.trial086.stdout:Total 2.6 MB/s | 132 MB 00:49 2026-02-20T11:27:30.921 INFO:teuthology.orchestra.run.trial046.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 1.6 MB/s | 182 kB 00:00 2026-02-20T11:27:30.981 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:27:30.993 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:27:30.993 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:27:31.030 INFO:teuthology.orchestra.run.trial046.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 2.4 MB/s | 266 kB 00:00 2026-02-20T11:27:31.386 INFO:teuthology.orchestra.run.trial046.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 83 kB/s | 30 kB 00:00 2026-02-20T11:27:31.425 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:27:31.425 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:27:31.881 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:27:31.890 INFO:teuthology.orchestra.run.trial086.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:27:31.899 INFO:teuthology.orchestra.run.trial086.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:27:31.904 INFO:teuthology.orchestra.run.trial086.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:27:31.908 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:27:31.910 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:27:31.915 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:27:31.915 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:27:31.934 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:27:31.937 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:27:31.940 INFO:teuthology.orchestra.run.trial046.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 5.4 MB/s | 3.0 MB 00:00 2026-02-20T11:27:31.948 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:27:31.956 INFO:teuthology.orchestra.run.trial086.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:27:31.957 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:27:32.034 INFO:teuthology.orchestra.run.trial046.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 159 kB/s | 15 kB 00:00 2026-02-20T11:27:32.137 INFO:teuthology.orchestra.run.trial046.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.3 MB/s | 246 kB 00:00 2026-02-20T11:27:32.240 INFO:teuthology.orchestra.run.trial046.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2026-02-20T11:27:32.337 INFO:teuthology.orchestra.run.trial046.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 431 kB/s | 42 kB 00:00 2026-02-20T11:27:32.560 INFO:teuthology.orchestra.run.trial046.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 24 MB/s | 5.3 MB 00:00 2026-02-20T11:27:32.822 INFO:teuthology.orchestra.run.trial046.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 6.0 MB 00:00 2026-02-20T11:27:32.923 INFO:teuthology.orchestra.run.trial046.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2026-02-20T11:27:33.027 INFO:teuthology.orchestra.run.trial046.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.3 MB/s | 249 kB 00:00 2026-02-20T11:27:33.123 INFO:teuthology.orchestra.run.trial046.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 492 kB/s | 48 kB 00:00 2026-02-20T11:27:33.233 INFO:teuthology.orchestra.run.trial046.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 1.6 MB/s | 177 kB 00:00 2026-02-20T11:27:33.350 INFO:teuthology.orchestra.run.trial046.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 10 MB/s | 1.2 MB 00:00 2026-02-20T11:27:33.453 INFO:teuthology.orchestra.run.trial046.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 339 kB/s | 35 kB 00:00 2026-02-20T11:27:33.713 INFO:teuthology.orchestra.run.trial046.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 24 MB/s | 6.1 MB 00:00 2026-02-20T11:27:33.819 INFO:teuthology.orchestra.run.trial046.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 4.1 MB/s | 442 kB 00:00 2026-02-20T11:27:33.919 INFO:teuthology.orchestra.run.trial046.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 776 kB/s | 77 kB 00:00 2026-02-20T11:27:34.022 INFO:teuthology.orchestra.run.trial046.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 2.5 MB/s | 267 kB 00:00 2026-02-20T11:27:34.124 INFO:teuthology.orchestra.run.trial046.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2026-02-20T11:27:34.227 INFO:teuthology.orchestra.run.trial046.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 2.6 MB/s | 279 kB 00:00 2026-02-20T11:27:34.324 INFO:teuthology.orchestra.run.trial046.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 556 kB/s | 54 kB 00:00 2026-02-20T11:27:34.971 INFO:teuthology.orchestra.run.trial046.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 30 MB/s | 19 MB 00:00 2026-02-20T11:27:35.072 INFO:teuthology.orchestra.run.trial046.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 412 kB/s | 42 kB 00:00 2026-02-20T11:27:35.179 INFO:teuthology.orchestra.run.trial046.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.7 MB/s | 189 kB 00:00 2026-02-20T11:27:35.291 INFO:teuthology.orchestra.run.trial046.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 808 kB/s | 90 kB 00:00 2026-02-20T11:27:35.424 INFO:teuthology.orchestra.run.trial046.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2026-02-20T11:27:35.551 INFO:teuthology.orchestra.run.trial046.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 6.6 MB/s | 862 kB 00:00 2026-02-20T11:27:35.723 INFO:teuthology.orchestra.run.trial046.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.1 MB/s | 551 kB 00:00 2026-02-20T11:27:35.744 INFO:teuthology.orchestra.run.trial046.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 921 kB/s | 19 kB 00:00 2026-02-20T11:27:35.765 INFO:teuthology.orchestra.run.trial046.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 6.8 MB/s | 151 kB 00:00 2026-02-20T11:27:35.807 INFO:teuthology.orchestra.run.trial046.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 13 MB/s | 548 kB 00:00 2026-02-20T11:27:35.840 INFO:teuthology.orchestra.run.trial046.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 916 kB/s | 29 kB 00:00 2026-02-20T11:27:35.861 INFO:teuthology.orchestra.run.trial046.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 2.8 MB/s | 60 kB 00:00 2026-02-20T11:27:35.882 INFO:teuthology.orchestra.run.trial046.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.0 MB/s | 43 kB 00:00 2026-02-20T11:27:35.903 INFO:teuthology.orchestra.run.trial046.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 1.5 MB/s | 32 kB 00:00 2026-02-20T11:27:35.924 INFO:teuthology.orchestra.run.trial046.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 676 kB/s | 14 kB 00:00 2026-02-20T11:27:35.946 INFO:teuthology.orchestra.run.trial046.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 7.8 MB/s | 173 kB 00:00 2026-02-20T11:27:35.969 INFO:teuthology.orchestra.run.trial046.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 15 MB/s | 358 kB 00:00 2026-02-20T11:27:35.991 INFO:teuthology.orchestra.run.trial046.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 11 MB/s | 254 kB 00:00 2026-02-20T11:27:36.037 INFO:teuthology.orchestra.run.trial046.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 45 MB/s | 2.0 MB 00:00 2026-02-20T11:27:36.059 INFO:teuthology.orchestra.run.trial046.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 6.5 MB/s | 144 kB 00:00 2026-02-20T11:27:36.081 INFO:teuthology.orchestra.run.trial046.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 6.2 MB/s | 139 kB 00:00 2026-02-20T11:27:36.102 INFO:teuthology.orchestra.run.trial046.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 2.6 MB/s | 56 kB 00:00 2026-02-20T11:27:36.123 INFO:teuthology.orchestra.run.trial046.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 506 kB/s | 11 kB 00:00 2026-02-20T11:27:36.144 INFO:teuthology.orchestra.run.trial046.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 838 kB/s | 18 kB 00:00 2026-02-20T11:27:36.170 INFO:teuthology.orchestra.run.trial046.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 902 kB/s | 23 kB 00:00 2026-02-20T11:27:36.191 INFO:teuthology.orchestra.run.trial046.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 925 kB/s | 20 kB 00:00 2026-02-20T11:27:36.229 INFO:teuthology.orchestra.run.trial046.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 517 kB/s | 19 kB 00:00 2026-02-20T11:27:36.251 INFO:teuthology.orchestra.run.trial046.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 1.2 MB/s | 26 kB 00:00 2026-02-20T11:27:36.277 INFO:teuthology.orchestra.run.trial046.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 39 MB/s | 1.0 MB 00:00 2026-02-20T11:27:36.299 INFO:teuthology.orchestra.run.trial046.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 3.6 MB/s | 79 kB 00:00 2026-02-20T11:27:36.350 INFO:teuthology.orchestra.run.trial046.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.6 MB/s | 86 kB 00:00 2026-02-20T11:27:36.375 INFO:teuthology.orchestra.run.trial046.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2026-02-20T11:27:36.397 INFO:teuthology.orchestra.run.trial046.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 782 kB/s | 16 kB 00:00 2026-02-20T11:27:36.418 INFO:teuthology.orchestra.run.trial046.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.1 MB/s | 90 kB 00:00 2026-02-20T11:27:36.440 INFO:teuthology.orchestra.run.trial046.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.4 MB/s | 31 kB 00:00 2026-02-20T11:27:36.462 INFO:teuthology.orchestra.run.trial046.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 8.5 MB/s | 188 kB 00:00 2026-02-20T11:27:36.483 INFO:teuthology.orchestra.run.trial046.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 2.7 MB/s | 59 kB 00:00 2026-02-20T11:27:36.505 INFO:teuthology.orchestra.run.trial046.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 5.7 MB/s | 125 kB 00:00 2026-02-20T11:27:36.527 INFO:teuthology.orchestra.run.trial046.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.6 MB/s | 36 kB 00:00 2026-02-20T11:27:36.549 INFO:teuthology.orchestra.run.trial046.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 4.0 MB/s | 86 kB 00:00 2026-02-20T11:27:36.570 INFO:teuthology.orchestra.run.trial046.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 4.1 MB/s | 90 kB 00:00 2026-02-20T11:27:36.591 INFO:teuthology.orchestra.run.trial046.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.2 MB/s | 48 kB 00:00 2026-02-20T11:27:36.612 INFO:teuthology.orchestra.run.trial046.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 1.0 MB/s | 22 kB 00:00 2026-02-20T11:27:36.634 INFO:teuthology.orchestra.run.trial046.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 942 kB/s | 20 kB 00:00 2026-02-20T11:27:38.907 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:27:38.925 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:27:39.706 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:27:39.706 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:27:39.706 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:27:39.706 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:27:39.707 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:27:39.707 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:27:39.707 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:27:39.707 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:27:39.707 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:27:39.707 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:27:39.707 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:27:39.707 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:27:39.761 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:27:39.762 INFO:teuthology.orchestra.run.trial086.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:27:39.763 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:27:39.763 INFO:teuthology.orchestra.run.trial086.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:27:39.763 INFO:teuthology.orchestra.run.trial086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:27:39.763 INFO:teuthology.orchestra.run.trial086.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:27:39.763 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:27:39.763 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:27:39.805 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph 2026-02-20T11:27:40.118 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:01:23 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:27:40.204 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:27:40.206 INFO:teuthology.orchestra.run.trial086.stdout:======================================================================================= 2026-02-20T11:27:40.207 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repository Size 2026-02-20T11:27:40.207 INFO:teuthology.orchestra.run.trial086.stdout:======================================================================================= 2026-02-20T11:27:40.207 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:27:40.207 INFO:teuthology.orchestra.run.trial086.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:27:40.207 INFO:teuthology.orchestra.run.trial086.stdout:Installing dependencies: 2026-02-20T11:27:40.207 INFO:teuthology.orchestra.run.trial086.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:27:40.207 INFO:teuthology.orchestra.run.trial086.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:27:40.207 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:27:40.207 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:27:40.208 INFO:teuthology.orchestra.run.trial086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:27:40.209 INFO:teuthology.orchestra.run.trial086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:27:40.210 INFO:teuthology.orchestra.run.trial086.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:27:40.211 INFO:teuthology.orchestra.run.trial086.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:27:40.212 INFO:teuthology.orchestra.run.trial086.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:27:40.213 INFO:teuthology.orchestra.run.trial086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-20T11:27:40.214 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout:======================================================================================= 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout:Install 96 Packages 2026-02-20T11:27:40.215 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:27:40.216 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 226 M 2026-02-20T11:27:40.216 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 1.5 G 2026-02-20T11:27:40.216 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:27:40.767 INFO:teuthology.orchestra.run.trial086.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 25 kB/s | 6.5 kB 00:00 2026-02-20T11:27:41.318 INFO:teuthology.orchestra.run.trial086.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 1.1 MB/s | 937 kB 00:00 2026-02-20T11:27:41.388 INFO:teuthology.orchestra.run.trial086.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 2.3 MB/s | 163 kB 00:00 2026-02-20T11:27:41.675 INFO:teuthology.orchestra.run.trial086.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 1.7 MB/s | 2.0 MB 00:01 2026-02-20T11:27:43.462 INFO:teuthology.orchestra.run.trial086.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 1.8 MB/s | 4.9 MB 00:02 2026-02-20T11:27:43.530 INFO:teuthology.orchestra.run.trial086.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 849 kB/s | 57 kB 00:00 2026-02-20T11:27:43.666 INFO:teuthology.orchestra.run.trial086.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 1.3 MB/s | 184 kB 00:00 2026-02-20T11:27:47.259 INFO:teuthology.orchestra.run.trial086.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 2.5 MB/s | 15 MB 00:05 2026-02-20T11:27:48.267 INFO:teuthology.orchestra.run.trial086.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 7.3 MB/s | 7.4 MB 00:01 2026-02-20T11:27:48.313 INFO:teuthology.orchestra.run.trial086.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 482 kB/s | 22 kB 00:00 2026-02-20T11:27:48.413 INFO:teuthology.orchestra.run.trial086.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 2.9 MB/s | 297 kB 00:00 2026-02-20T11:27:48.465 INFO:teuthology.orchestra.run.trial086.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 985 kB/s | 50 kB 00:00 2026-02-20T11:27:48.518 INFO:teuthology.orchestra.run.trial086.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 328 kB/s | 17 kB 00:00 2026-02-20T11:27:48.635 INFO:teuthology.orchestra.run.trial086.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 2.5 MB/s | 301 kB 00:00 2026-02-20T11:27:49.001 INFO:teuthology.orchestra.run.trial086.stdout:(15/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 2.8 MB/s | 1.0 MB 00:00 2026-02-20T11:27:49.050 INFO:teuthology.orchestra.run.trial086.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 7.0 MB/s | 351 kB 00:00 2026-02-20T11:27:49.059 INFO:teuthology.orchestra.run.trial086.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 4.7 MB/s | 40 kB 00:00 2026-02-20T11:27:49.068 INFO:teuthology.orchestra.run.trial086.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 7.9 MB/s | 72 kB 00:00 2026-02-20T11:27:49.087 INFO:teuthology.orchestra.run.trial086.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 40 MB/s | 794 kB 00:00 2026-02-20T11:27:49.099 INFO:teuthology.orchestra.run.trial086.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 16 MB/s | 184 kB 00:00 2026-02-20T11:27:49.110 INFO:teuthology.orchestra.run.trial086.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 22 MB/s | 253 kB 00:00 2026-02-20T11:27:49.143 INFO:teuthology.orchestra.run.trial086.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 38 MB/s | 1.2 MB 00:00 2026-02-20T11:27:49.153 INFO:teuthology.orchestra.run.trial086.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 10 MB/s | 106 kB 00:00 2026-02-20T11:27:49.163 INFO:teuthology.orchestra.run.trial086.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 13 MB/s | 135 kB 00:00 2026-02-20T11:27:49.174 INFO:teuthology.orchestra.run.trial086.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 14 MB/s | 150 kB 00:00 2026-02-20T11:27:49.185 INFO:teuthology.orchestra.run.trial086.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 11 MB/s | 126 kB 00:00 2026-02-20T11:27:49.196 INFO:teuthology.orchestra.run.trial086.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 20 MB/s | 218 kB 00:00 2026-02-20T11:27:49.207 INFO:teuthology.orchestra.run.trial086.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-20T11:27:49.217 INFO:teuthology.orchestra.run.trial086.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 25 MB/s | 266 kB 00:00 2026-02-20T11:27:49.378 INFO:teuthology.orchestra.run.trial086.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 184 kB/s | 30 kB 00:00 2026-02-20T11:27:49.566 INFO:teuthology.orchestra.run.trial086.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 16 MB/s | 3.0 MB 00:00 2026-02-20T11:27:49.591 INFO:teuthology.orchestra.run.trial086.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 590 kB/s | 15 kB 00:00 2026-02-20T11:27:49.642 INFO:teuthology.orchestra.run.trial086.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 4.8 MB/s | 246 kB 00:00 2026-02-20T11:27:49.669 INFO:teuthology.orchestra.run.trial086.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 6.8 MB/s | 188 kB 00:00 2026-02-20T11:27:49.694 INFO:teuthology.orchestra.run.trial086.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-20T11:27:49.759 INFO:teuthology.orchestra.run.trial086.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 82 MB/s | 5.3 MB 00:00 2026-02-20T11:27:49.824 INFO:teuthology.orchestra.run.trial086.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 92 MB/s | 6.0 MB 00:00 2026-02-20T11:27:49.851 INFO:teuthology.orchestra.run.trial086.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 8.6 MB/s | 244 kB 00:00 2026-02-20T11:27:49.879 INFO:teuthology.orchestra.run.trial086.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 8.8 MB/s | 249 kB 00:00 2026-02-20T11:27:49.906 INFO:teuthology.orchestra.run.trial086.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 1.8 MB/s | 48 kB 00:00 2026-02-20T11:27:49.932 INFO:teuthology.orchestra.run.trial086.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 6.5 MB/s | 177 kB 00:00 2026-02-20T11:27:49.962 INFO:teuthology.orchestra.run.trial086.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 40 MB/s | 1.2 MB 00:00 2026-02-20T11:27:49.988 INFO:teuthology.orchestra.run.trial086.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 1.3 MB/s | 35 kB 00:00 2026-02-20T11:27:50.053 INFO:teuthology.orchestra.run.trial086.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 95 MB/s | 6.1 MB 00:00 2026-02-20T11:27:50.082 INFO:teuthology.orchestra.run.trial086.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 15 MB/s | 442 kB 00:00 2026-02-20T11:27:50.108 INFO:teuthology.orchestra.run.trial086.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 2.9 MB/s | 77 kB 00:00 2026-02-20T11:27:50.135 INFO:teuthology.orchestra.run.trial086.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 9.8 MB/s | 267 kB 00:00 2026-02-20T11:27:50.163 INFO:teuthology.orchestra.run.trial086.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 5.7 MB/s | 159 kB 00:00 2026-02-20T11:27:50.191 INFO:teuthology.orchestra.run.trial086.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 9.8 MB/s | 279 kB 00:00 2026-02-20T11:27:50.217 INFO:teuthology.orchestra.run.trial086.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 2.0 MB/s | 54 kB 00:00 2026-02-20T11:27:50.398 INFO:teuthology.orchestra.run.trial086.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 106 MB/s | 19 MB 00:00 2026-02-20T11:27:50.424 INFO:teuthology.orchestra.run.trial086.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 42 kB 00:00 2026-02-20T11:27:50.451 INFO:teuthology.orchestra.run.trial086.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 7.0 MB/s | 189 kB 00:00 2026-02-20T11:27:50.477 INFO:teuthology.orchestra.run.trial086.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 3.4 MB/s | 90 kB 00:00 2026-02-20T11:27:50.600 INFO:teuthology.orchestra.run.trial086.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 181 kB/s | 22 kB 00:00 2026-02-20T11:27:50.686 INFO:teuthology.orchestra.run.trial086.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 9.9 MB/s | 862 kB 00:00 2026-02-20T11:27:51.141 INFO:teuthology.orchestra.run.trial086.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.2 MB/s | 551 kB 00:00 2026-02-20T11:27:51.288 INFO:teuthology.orchestra.run.trial086.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 132 kB/s | 19 kB 00:00 2026-02-20T11:27:51.536 INFO:teuthology.orchestra.run.trial086.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 612 kB/s | 151 kB 00:00 2026-02-20T11:27:51.931 INFO:teuthology.orchestra.run.trial086.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 1.4 MB/s | 548 kB 00:00 2026-02-20T11:27:52.078 INFO:teuthology.orchestra.run.trial086.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 201 kB/s | 29 kB 00:00 2026-02-20T11:27:52.266 INFO:teuthology.orchestra.run.trial086.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 320 kB/s | 60 kB 00:00 2026-02-20T11:27:52.450 INFO:teuthology.orchestra.run.trial086.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 236 kB/s | 43 kB 00:00 2026-02-20T11:27:52.602 INFO:teuthology.orchestra.run.trial086.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 211 kB/s | 32 kB 00:00 2026-02-20T11:27:52.695 INFO:teuthology.orchestra.run.trial086.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 153 kB/s | 14 kB 00:00 2026-02-20T11:27:52.926 INFO:teuthology.orchestra.run.trial086.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 749 kB/s | 173 kB 00:00 2026-02-20T11:27:53.260 INFO:teuthology.orchestra.run.trial086.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 1.0 MB/s | 358 kB 00:00 2026-02-20T11:27:53.549 INFO:teuthology.orchestra.run.trial086.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 881 kB/s | 254 kB 00:00 2026-02-20T11:27:54.256 INFO:teuthology.orchestra.run.trial086.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.9 MB/s | 2.0 MB 00:00 2026-02-20T11:27:54.514 INFO:teuthology.orchestra.run.trial086.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 560 kB/s | 144 kB 00:00 2026-02-20T11:27:54.744 INFO:teuthology.orchestra.run.trial086.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 605 kB/s | 139 kB 00:00 2026-02-20T11:27:54.926 INFO:teuthology.orchestra.run.trial086.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 308 kB/s | 56 kB 00:00 2026-02-20T11:27:55.031 INFO:teuthology.orchestra.run.trial086.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 101 kB/s | 11 kB 00:00 2026-02-20T11:27:55.181 INFO:teuthology.orchestra.run.trial086.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 118 kB/s | 18 kB 00:00 2026-02-20T11:27:55.397 INFO:teuthology.orchestra.run.trial086.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 107 kB/s | 23 kB 00:00 2026-02-20T11:27:55.537 INFO:teuthology.orchestra.run.trial086.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 140 kB/s | 20 kB 00:00 2026-02-20T11:27:55.678 INFO:teuthology.orchestra.run.trial086.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 138 kB/s | 19 kB 00:00 2026-02-20T11:27:55.820 INFO:teuthology.orchestra.run.trial086.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 186 kB/s | 26 kB 00:00 2026-02-20T11:27:56.285 INFO:teuthology.orchestra.run.trial086.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 2.2 MB/s | 1.0 MB 00:00 2026-02-20T11:27:56.471 INFO:teuthology.orchestra.run.trial086.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 425 kB/s | 79 kB 00:00 2026-02-20T11:27:56.670 INFO:teuthology.orchestra.run.trial086.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 434 kB/s | 86 kB 00:00 2026-02-20T11:27:56.860 INFO:teuthology.orchestra.run.trial086.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 305 kB/s | 58 kB 00:00 2026-02-20T11:27:57.034 INFO:teuthology.orchestra.run.trial086.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 94 kB/s | 16 kB 00:00 2026-02-20T11:27:57.218 INFO:teuthology.orchestra.run.trial086.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 488 kB/s | 90 kB 00:00 2026-02-20T11:27:57.370 INFO:teuthology.orchestra.run.trial086.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 202 kB/s | 31 kB 00:00 2026-02-20T11:27:57.603 INFO:teuthology.orchestra.run.trial086.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 810 kB/s | 188 kB 00:00 2026-02-20T11:27:57.785 INFO:teuthology.orchestra.run.trial086.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 325 kB/s | 59 kB 00:00 2026-02-20T11:27:58.012 INFO:teuthology.orchestra.run.trial086.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 549 kB/s | 125 kB 00:00 2026-02-20T11:27:58.149 INFO:teuthology.orchestra.run.trial086.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 262 kB/s | 36 kB 00:00 2026-02-20T11:27:58.343 INFO:teuthology.orchestra.run.trial086.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 445 kB/s | 86 kB 00:00 2026-02-20T11:27:58.533 INFO:teuthology.orchestra.run.trial086.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 473 kB/s | 90 kB 00:00 2026-02-20T11:27:58.714 INFO:teuthology.orchestra.run.trial086.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 268 kB/s | 48 kB 00:00 2026-02-20T11:27:58.858 INFO:teuthology.orchestra.run.trial086.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 153 kB/s | 22 kB 00:00 2026-02-20T11:27:58.995 INFO:teuthology.orchestra.run.trial086.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 146 kB/s | 20 kB 00:00 2026-02-20T11:28:01.479 INFO:teuthology.orchestra.run.trial086.stdout:(95/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 2.8 MB/s | 51 MB 00:17 2026-02-20T11:28:01.949 INFO:teuthology.orchestra.run.trial046.stdout:(95/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 1.3 MB/s | 51 MB 00:37 2026-02-20T11:28:11.843 INFO:teuthology.orchestra.run.trial046.stdout:(96/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 1.8 MB/s | 88 MB 00:50 2026-02-20T11:28:11.846 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:11.847 INFO:teuthology.orchestra.run.trial046.stdout:Total 4.4 MB/s | 226 MB 00:51 2026-02-20T11:28:12.233 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:28:12.271 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:28:12.272 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:28:13.076 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:28:13.076 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:28:13.919 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:28:13.920 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:28:13.924 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:28:13.946 INFO:teuthology.orchestra.run.trial046.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:28:13.979 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:28:13.986 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:28:13.988 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:28:13.993 INFO:teuthology.orchestra.run.trial046.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:28:14.016 INFO:teuthology.orchestra.run.trial046.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:28:14.028 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:28:14.032 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:28:14.038 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:28:14.040 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:28:14.052 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:28:14.058 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:28:14.083 INFO:teuthology.orchestra.run.trial046.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:28:14.086 INFO:teuthology.orchestra.run.trial046.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:28:14.137 INFO:teuthology.orchestra.run.trial046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:28:14.149 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:28:14.152 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:28:14.156 INFO:teuthology.orchestra.run.trial046.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:28:14.162 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:28:14.166 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:28:14.169 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:28:14.184 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:28:14.188 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:28:14.193 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:28:14.205 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:28:14.214 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:28:14.221 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:28:14.241 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:28:14.252 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:28:14.267 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:28:14.272 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:28:14.280 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:28:14.320 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:28:14.645 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:28:14.655 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:28:14.659 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:28:14.664 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:28:14.666 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:28:14.694 INFO:teuthology.orchestra.run.trial046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:28:14.738 INFO:teuthology.orchestra.run.trial046.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:28:14.747 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:28:14.753 INFO:teuthology.orchestra.run.trial046.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:28:14.756 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:28:14.762 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:28:14.766 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:28:14.773 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:28:14.776 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:28:14.804 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:28:14.814 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:28:14.819 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:28:14.826 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:28:14.861 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:28:15.087 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:28:15.111 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:28:15.114 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:28:15.174 INFO:teuthology.orchestra.run.trial046.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:28:15.176 INFO:teuthology.orchestra.run.trial046.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:28:15.197 INFO:teuthology.orchestra.run.trial046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:28:15.524 INFO:teuthology.orchestra.run.trial046.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:28:15.598 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:28:16.273 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:28:16.290 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:28:16.300 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:28:16.307 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:28:16.320 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:28:16.336 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:28:16.412 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:28:16.421 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:28:16.444 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:28:16.474 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:28:16.525 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:28:16.531 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:28:16.534 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:28:16.535 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:28:16.553 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:28:16.553 INFO:teuthology.orchestra.run.trial046.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:28:16.553 INFO:teuthology.orchestra.run.trial046.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:28:16.553 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:16.562 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:28:16.588 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:28:16.588 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:28:16.588 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:16.622 INFO:teuthology.orchestra.run.trial046.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:28:17.213 INFO:teuthology.orchestra.run.trial046.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:28:21.684 INFO:teuthology.orchestra.run.trial086.stdout:(96/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 2.2 MB/s | 88 MB 00:40 2026-02-20T11:28:21.686 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:21.686 INFO:teuthology.orchestra.run.trial086.stdout:Total 5.4 MB/s | 226 MB 00:41 2026-02-20T11:28:22.070 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:28:22.107 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:28:22.107 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:28:22.656 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:28:22.720 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:28:22.722 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:28:22.735 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:28:22.736 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:22.736 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:28:22.736 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:22.747 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:28:22.771 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:28:22.771 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:22.771 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:28:22.771 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:28:22.772 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:28:22.772 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:22.832 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:28:22.833 INFO:teuthology.orchestra.run.trial046.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:28:22.843 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:28:22.867 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:28:22.868 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:28:22.904 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:28:22.905 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:28:23.761 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:28:23.763 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:28:23.767 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:28:23.788 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:28:23.821 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:28:23.827 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:28:23.830 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:28:23.834 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:28:23.857 INFO:teuthology.orchestra.run.trial086.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:28:23.869 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:28:23.872 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:28:23.878 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:28:23.880 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:28:23.891 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:28:23.897 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:28:23.921 INFO:teuthology.orchestra.run.trial086.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:28:23.924 INFO:teuthology.orchestra.run.trial086.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:28:23.974 INFO:teuthology.orchestra.run.trial086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:28:23.987 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:28:23.989 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:28:23.993 INFO:teuthology.orchestra.run.trial086.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:28:23.998 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:28:24.003 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:28:24.006 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:28:24.021 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:28:24.025 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:28:24.030 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:28:24.041 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:28:24.050 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:28:24.056 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:28:24.075 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:28:24.086 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:28:24.101 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:28:24.106 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:28:24.113 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:28:24.153 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:28:24.472 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:28:24.482 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:28:24.486 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:28:24.491 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:28:24.493 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:28:24.520 INFO:teuthology.orchestra.run.trial086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:28:24.563 INFO:teuthology.orchestra.run.trial086.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:28:24.573 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:28:24.579 INFO:teuthology.orchestra.run.trial086.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:28:24.582 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:28:24.587 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:28:24.591 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:28:24.598 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:28:24.601 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:28:24.628 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:28:24.638 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:28:24.643 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:28:24.650 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:28:24.684 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:28:24.905 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:28:24.928 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:28:24.932 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:28:24.990 INFO:teuthology.orchestra.run.trial086.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:28:24.992 INFO:teuthology.orchestra.run.trial086.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:28:25.013 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:28:25.333 INFO:teuthology.orchestra.run.trial086.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:28:25.405 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:28:25.781 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:28:25.788 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:28:26.066 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:28:26.082 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:28:26.092 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:28:26.098 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:28:26.111 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:28:26.127 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:28:26.201 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:28:26.210 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:28:26.233 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:28:26.242 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:28:26.244 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:28:26.255 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:28:26.256 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:28:26.262 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:28:26.312 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:28:26.318 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:28:26.319 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:28:26.321 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:28:26.323 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:28:26.340 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:28:26.340 INFO:teuthology.orchestra.run.trial086.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:28:26.340 INFO:teuthology.orchestra.run.trial086.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:28:26.340 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:26.349 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:28:26.360 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:28:26.361 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:28:26.373 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:28:26.373 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:28:26.373 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:26.381 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:28:26.381 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:26.381 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:28:26.381 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:28:26.381 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:28:26.382 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:26.393 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:28:26.407 INFO:teuthology.orchestra.run.trial086.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:28:26.608 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:28:26.609 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:28:26.631 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:28:26.631 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:26.631 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:28:26.631 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:28:26.631 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:28:26.632 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:26.714 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:28:26.734 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:28:26.734 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:26.734 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:28:26.734 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:28:26.734 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:28:26.734 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:26.735 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:28:26.741 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:28:26.764 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:28:26.994 INFO:teuthology.orchestra.run.trial086.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:28:28.158 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:28:28.158 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:28:28.159 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:28:28.162 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:28:28.163 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:28:28.164 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:28:28.228 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:28:28.228 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:28.228 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:28:28.228 INFO:teuthology.orchestra.run.trial046.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.229 INFO:teuthology.orchestra.run.trial046.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:28:28.230 INFO:teuthology.orchestra.run.trial046.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:28:28.231 INFO:teuthology.orchestra.run.trial046.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:28:28.232 INFO:teuthology.orchestra.run.trial046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:28:28.233 INFO:teuthology.orchestra.run.trial046.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:28:28.234 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:28:28.235 INFO:teuthology.orchestra.run.trial046.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:28:28.236 INFO:teuthology.orchestra.run.trial046.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:28:28.237 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:28.237 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:28.298 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-base 2026-02-20T11:28:28.611 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:10 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:28.676 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:28.695 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:28.696 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:28.696 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:28.717 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install cephadm 2026-02-20T11:28:29.022 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:11 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:29.087 INFO:teuthology.orchestra.run.trial046.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:29.105 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:29.106 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:29.106 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:29.126 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:28:29.438 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:11 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:29.522 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:29.522 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:29.522 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-20T11:28:29.522 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:29.522 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:28:29.523 INFO:teuthology.orchestra.run.trial046.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:28:29.523 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:29.523 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:28:29.523 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:29.523 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-20T11:28:29.523 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:29.523 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 149 k 2026-02-20T11:28:29.523 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 455 k 2026-02-20T11:28:29.523 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:28:29.971 INFO:teuthology.orchestra.run.trial046.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 334 kB/s | 149 kB 00:00 2026-02-20T11:28:29.971 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:29.971 INFO:teuthology.orchestra.run.trial046.stdout:Total 333 kB/s | 149 kB 00:00 2026-02-20T11:28:29.971 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:28:29.976 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:28:29.976 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:28:30.007 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:28:30.007 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:28:30.062 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:28:30.063 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:28:30.087 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:28:30.087 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:30.087 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:28:30.087 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:30.391 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:28:30.392 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:30.392 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:28:30.392 INFO:teuthology.orchestra.run.trial046.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:30.392 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:30.392 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:30.420 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr 2026-02-20T11:28:30.729 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:12 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:30.794 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:30.812 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:30.813 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:30.813 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:30.834 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:28:31.144 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:13 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:31.208 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:31.227 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:31.227 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:31.228 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:31.249 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:28:31.560 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:13 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:31.627 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:31.645 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:31.646 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:31.646 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:31.668 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:28:31.977 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:13 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:32.042 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:32.060 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:32.061 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:32.061 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:32.083 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:28:32.394 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:14 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:32.412 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:28:32.458 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:32.475 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:28:32.476 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:32.476 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:32.476 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:32.477 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:28:32.491 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:28:32.491 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:32.491 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:28:32.491 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:32.498 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd 2026-02-20T11:28:32.501 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:28:32.523 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:28:32.523 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:32.524 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:28:32.524 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:28:32.524 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:28:32.524 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:32.581 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:28:32.583 INFO:teuthology.orchestra.run.trial086.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:28:32.592 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:28:32.616 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:28:32.618 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:28:32.806 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:14 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:32.870 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:32.889 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:32.889 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:32.889 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:32.911 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd-classic 2026-02-20T11:28:33.219 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:15 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:33.283 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:33.301 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:33.301 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:33.302 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:33.323 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-fuse 2026-02-20T11:28:33.631 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:15 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:33.715 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:33.715 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:33.715 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-20T11:28:33.715 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 914 k 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 2.9 M 2026-02-20T11:28:33.716 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:28:34.569 INFO:teuthology.orchestra.run.trial046.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.0 MB/s | 914 kB 00:00 2026-02-20T11:28:34.570 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:34.570 INFO:teuthology.orchestra.run.trial046.stdout:Total 1.0 MB/s | 914 kB 00:00 2026-02-20T11:28:34.570 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:28:34.575 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:28:34.575 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:28:34.608 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:28:34.608 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:28:34.699 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:28:34.716 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:34.959 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:35.016 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:35.017 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:35.017 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:28:35.017 INFO:teuthology.orchestra.run.trial046.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:35.017 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:35.017 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:35.044 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-volume 2026-02-20T11:28:35.357 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:17 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:35.422 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:35.440 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:35.441 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:35.441 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:35.463 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librados-devel 2026-02-20T11:28:35.507 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:28:35.514 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:28:35.779 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:17 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:35.862 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:35.862 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:35.862 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-20T11:28:35.862 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:35.862 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:28:35.862 INFO:teuthology.orchestra.run.trial046.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:28:35.862 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:35.862 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:28:35.863 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:35.863 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-20T11:28:35.863 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:35.863 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 124 k 2026-02-20T11:28:35.863 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 434 k 2026-02-20T11:28:35.863 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:28:35.965 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:28:35.966 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:28:35.977 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:28:35.978 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:28:36.039 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:28:36.079 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:28:36.080 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:28:36.101 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:28:36.102 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:36.102 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:28:36.102 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:28:36.102 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:28:36.102 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:36.114 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:28:36.290 INFO:teuthology.orchestra.run.trial046.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 290 kB/s | 124 kB 00:00 2026-02-20T11:28:36.290 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:36.290 INFO:teuthology.orchestra.run.trial046.stdout:Total 289 kB/s | 124 kB 00:00 2026-02-20T11:28:36.290 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:28:36.293 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:28:36.293 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:28:36.327 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:28:36.328 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:28:36.328 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:28:36.329 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:28:36.350 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:28:36.350 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:36.350 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:28:36.350 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:28:36.350 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:28:36.350 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:36.384 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:28:36.400 INFO:teuthology.orchestra.run.trial046.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:36.432 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:28:36.452 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:28:36.453 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:36.453 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:28:36.453 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:28:36.453 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:28:36.453 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:36.454 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:28:36.460 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:28:36.481 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:36.484 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:28:36.539 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:36.539 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:36.539 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:28:36.540 INFO:teuthology.orchestra.run.trial046.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:36.540 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:36.540 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:36.567 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install libcephfs2 2026-02-20T11:28:36.880 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:18 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:36.945 INFO:teuthology.orchestra.run.trial046.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:36.963 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:36.964 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:36.964 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:36.985 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install libcephfs-devel 2026-02-20T11:28:37.290 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:19 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:37.372 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:37.372 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 37 k 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 171 k 2026-02-20T11:28:37.373 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:28:37.698 INFO:teuthology.orchestra.run.trial046.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 115 kB/s | 37 kB 00:00 2026-02-20T11:28:37.698 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:37.698 INFO:teuthology.orchestra.run.trial046.stdout:Total 115 kB/s | 37 kB 00:00 2026-02-20T11:28:37.698 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:28:37.701 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:28:37.701 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:28:37.704 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:28:37.704 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:28:37.725 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:28:37.741 INFO:teuthology.orchestra.run.trial046.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:37.795 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:37.853 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:28:37.854 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:28:37.855 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:28:37.856 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial046.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:37.857 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:37.877 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librados2 2026-02-20T11:28:37.921 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:28:37.921 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:37.921 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:28:37.921 INFO:teuthology.orchestra.run.trial086.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:28:37.921 INFO:teuthology.orchestra.run.trial086.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:37.921 INFO:teuthology.orchestra.run.trial086.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.921 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:37.921 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:28:37.922 INFO:teuthology.orchestra.run.trial086.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:28:37.923 INFO:teuthology.orchestra.run.trial086.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:28:37.924 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:28:37.925 INFO:teuthology.orchestra.run.trial086.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:28:37.925 INFO:teuthology.orchestra.run.trial086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:28:37.925 INFO:teuthology.orchestra.run.trial086.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:28:37.925 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:28:37.925 INFO:teuthology.orchestra.run.trial086.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:28:37.925 INFO:teuthology.orchestra.run.trial086.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:28:37.925 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:37.925 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:37.990 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-base 2026-02-20T11:28:38.186 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:20 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:38.253 INFO:teuthology.orchestra.run.trial046.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:38.271 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:38.272 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:38.272 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:38.293 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librbd1 2026-02-20T11:28:38.302 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:21 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:38.369 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:38.387 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:38.388 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:38.388 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:38.409 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install cephadm 2026-02-20T11:28:38.611 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:20 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:38.676 INFO:teuthology.orchestra.run.trial046.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:38.694 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:38.695 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:38.695 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:38.715 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rados 2026-02-20T11:28:38.722 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:21 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:38.787 INFO:teuthology.orchestra.run.trial086.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:38.805 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:38.805 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:38.806 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:38.827 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:28:39.021 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:21 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:39.086 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:39.105 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:39.105 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:39.105 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:39.126 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rgw 2026-02-20T11:28:39.130 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:22 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:39.213 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 149 k 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 455 k 2026-02-20T11:28:39.214 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:28:39.437 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:21 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:39.503 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:39.521 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:39.522 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:39.522 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:39.543 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-cephfs 2026-02-20T11:28:39.762 INFO:teuthology.orchestra.run.trial086.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 273 kB/s | 149 kB 00:00 2026-02-20T11:28:39.762 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:39.762 INFO:teuthology.orchestra.run.trial086.stdout:Total 273 kB/s | 149 kB 00:00 2026-02-20T11:28:39.763 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:28:39.767 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:28:39.767 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:28:39.799 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:28:39.799 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:28:39.847 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:21 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:39.855 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:28:39.856 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:28:39.879 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:28:39.880 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:39.880 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:28:39.880 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:39.911 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:39.930 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:39.931 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:39.931 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:39.950 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rbd 2026-02-20T11:28:40.180 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:28:40.180 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:40.180 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:28:40.180 INFO:teuthology.orchestra.run.trial086.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:40.181 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:40.181 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:40.206 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr 2026-02-20T11:28:40.257 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:22 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:40.322 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:40.340 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:40.341 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:40.341 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:40.363 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-fuse 2026-02-20T11:28:40.514 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:23 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:40.580 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:40.598 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:40.599 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:40.599 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:40.620 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:28:40.672 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:22 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 86 k 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 236 k 2026-02-20T11:28:40.756 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:28:40.926 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:23 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:40.991 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:41.009 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:41.009 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:41.010 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:41.030 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:28:41.125 INFO:teuthology.orchestra.run.trial046.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 235 kB/s | 86 kB 00:00 2026-02-20T11:28:41.125 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:41.125 INFO:teuthology.orchestra.run.trial046.stdout:Total 235 kB/s | 86 kB 00:00 2026-02-20T11:28:41.125 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:28:41.129 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:28:41.129 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:28:41.160 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:28:41.160 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:28:41.211 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:28:41.228 INFO:teuthology.orchestra.run.trial046.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:41.311 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:41.340 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:24 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:41.369 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:41.369 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:41.369 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:28:41.369 INFO:teuthology.orchestra.run.trial046.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:41.369 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:41.370 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:41.397 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-mirror 2026-02-20T11:28:41.405 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:41.423 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:41.423 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:41.424 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:41.444 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:28:41.715 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:23 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:41.748 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:24 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:41.799 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:41.800 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:41.800 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-20T11:28:41.800 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:41.800 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:28:41.801 INFO:teuthology.orchestra.run.trial046.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:28:41.801 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:41.801 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:28:41.801 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:41.801 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-20T11:28:41.801 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:41.801 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 2.6 M 2026-02-20T11:28:41.801 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 11 M 2026-02-20T11:28:41.802 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:28:41.813 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:41.832 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:41.833 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:41.833 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:41.854 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:28:42.167 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:25 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:42.231 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:42.249 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:42.250 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:42.250 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:42.272 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd 2026-02-20T11:28:42.577 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:25 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:42.642 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:42.660 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:42.661 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:42.661 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:42.681 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd-classic 2026-02-20T11:28:42.684 INFO:teuthology.orchestra.run.trial046.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 2.9 MB/s | 2.6 MB 00:00 2026-02-20T11:28:42.684 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:42.684 INFO:teuthology.orchestra.run.trial046.stdout:Total 2.9 MB/s | 2.6 MB 00:00 2026-02-20T11:28:42.684 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:28:42.690 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:28:42.690 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:28:42.729 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:28:42.730 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:28:42.892 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:28:42.893 INFO:teuthology.orchestra.run.trial046.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:42.916 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:42.916 INFO:teuthology.orchestra.run.trial046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:42.916 INFO:teuthology.orchestra.run.trial046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:28:42.917 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:28:42.917 INFO:teuthology.orchestra.run.trial046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:28:42.917 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:42.991 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:25 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:43.056 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:43.075 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:43.075 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:43.076 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:43.096 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-fuse 2026-02-20T11:28:43.226 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:43.227 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:43.227 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:28:43.227 INFO:teuthology.orchestra.run.trial046.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:43.227 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:43.227 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:43.256 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-nbd 2026-02-20T11:28:43.409 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:26 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:43.494 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:43.494 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:43.494 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-20T11:28:43.494 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:43.494 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:28:43.494 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:28:43.495 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:43.495 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:28:43.495 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:43.495 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-20T11:28:43.495 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:43.495 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 914 k 2026-02-20T11:28:43.495 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 2.9 M 2026-02-20T11:28:43.495 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:28:43.570 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:25 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:43.654 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:43.654 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout: Package Architecture Version Repository Size 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout:Install 1 Package 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 167 k 2026-02-20T11:28:43.655 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 496 k 2026-02-20T11:28:43.656 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:28:44.142 INFO:teuthology.orchestra.run.trial046.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 342 kB/s | 167 kB 00:00 2026-02-20T11:28:44.142 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:44.143 INFO:teuthology.orchestra.run.trial046.stdout:Total 342 kB/s | 167 kB 00:00 2026-02-20T11:28:44.143 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:28:44.150 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:28:44.150 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:28:44.184 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:28:44.184 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:28:44.242 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:28:44.258 INFO:teuthology.orchestra.run.trial046.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:44.340 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:44.380 INFO:teuthology.orchestra.run.trial086.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.0 MB/s | 914 kB 00:00 2026-02-20T11:28:44.380 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:44.380 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.0 MB/s | 914 kB 00:00 2026-02-20T11:28:44.380 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:28:44.385 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:28:44.385 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:28:44.398 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:44.399 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:44.399 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:28:44.399 INFO:teuthology.orchestra.run.trial046.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:44.399 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:44.399 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:44.419 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:28:44.419 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:28:44.426 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:28:44.510 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:28:44.527 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:44.739 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:26 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:44.781 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:44.802 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:44.821 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:44.821 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:28:44.822 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:28:44.839 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:44.839 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:44.839 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:28:44.839 INFO:teuthology.orchestra.run.trial086.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:44.839 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:44.840 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:44.844 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:28:44.866 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-volume 2026-02-20T11:28:45.155 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:02:27 ago on Fri 20 Feb 2026 11:26:18 AM UTC. 2026-02-20T11:28:45.172 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:28 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:45.237 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:28:45.238 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:28:45.238 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:45.238 INFO:teuthology.orchestra.run.trial046.stdout: Package Arch Version Repo Size 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout:Installing: 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout:Installing weak dependencies: 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout:Transaction Summary 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout:================================================================================ 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout:Install 2 Packages 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout:Total download size: 445 M 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout:Installed size: 2.7 G 2026-02-20T11:28:45.239 INFO:teuthology.orchestra.run.trial046.stdout:Downloading Packages: 2026-02-20T11:28:45.256 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:45.256 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:45.256 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:45.276 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados-devel 2026-02-20T11:28:45.585 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:28 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:45.669 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:45.669 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:45.669 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-20T11:28:45.669 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:45.669 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:28:45.669 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:28:45.670 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:45.670 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:28:45.670 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:45.670 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-20T11:28:45.670 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:45.670 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 124 k 2026-02-20T11:28:45.670 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 434 k 2026-02-20T11:28:45.670 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:28:46.144 INFO:teuthology.orchestra.run.trial086.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 260 kB/s | 124 kB 00:00 2026-02-20T11:28:46.146 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:46.146 INFO:teuthology.orchestra.run.trial086.stdout:Total 259 kB/s | 124 kB 00:00 2026-02-20T11:28:46.146 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:28:46.149 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:28:46.149 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:28:46.184 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:28:46.184 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:28:46.241 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:28:46.258 INFO:teuthology.orchestra.run.trial086.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:46.337 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:46.396 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:46.397 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:46.397 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:28:46.397 INFO:teuthology.orchestra.run.trial086.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.397 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:46.397 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:46.424 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs2 2026-02-20T11:28:46.737 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:29 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:46.802 INFO:teuthology.orchestra.run.trial086.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:46.820 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:46.821 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:46.821 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:46.843 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs-devel 2026-02-20T11:28:47.154 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:30 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:47.237 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:47.238 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:47.238 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-20T11:28:47.238 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:47.238 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:28:47.238 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:28:47.238 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:47.238 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:28:47.238 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:47.238 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-20T11:28:47.239 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:47.239 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 37 k 2026-02-20T11:28:47.239 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 171 k 2026-02-20T11:28:47.239 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:28:47.564 INFO:teuthology.orchestra.run.trial086.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 115 kB/s | 37 kB 00:00 2026-02-20T11:28:47.565 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:47.565 INFO:teuthology.orchestra.run.trial086.stdout:Total 114 kB/s | 37 kB 00:00 2026-02-20T11:28:47.566 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:28:47.568 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:28:47.568 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:28:47.570 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:28:47.571 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:28:47.592 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:28:47.608 INFO:teuthology.orchestra.run.trial086.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:47.664 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:47.722 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:47.722 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:47.722 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:28:47.722 INFO:teuthology.orchestra.run.trial086.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:47.722 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:47.722 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:47.749 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados2 2026-02-20T11:28:48.059 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:31 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:48.124 INFO:teuthology.orchestra.run.trial086.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:48.143 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:48.144 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:48.144 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:48.165 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librbd1 2026-02-20T11:28:48.480 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:31 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:48.544 INFO:teuthology.orchestra.run.trial086.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:48.563 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:48.563 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:48.563 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:48.585 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rados 2026-02-20T11:28:48.896 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:31 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:48.961 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:48.979 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:48.980 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:48.980 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:49.001 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rgw 2026-02-20T11:28:49.318 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:32 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:49.384 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:49.402 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:49.403 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:49.403 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:49.424 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-cephfs 2026-02-20T11:28:49.734 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:32 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:49.798 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:49.817 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:49.818 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:49.818 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:49.839 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rbd 2026-02-20T11:28:50.148 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:33 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:50.213 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:50.231 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:50.232 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:50.232 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:50.236 INFO:teuthology.orchestra.run.trial046.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 2.4 MB/s | 12 MB 00:04 2026-02-20T11:28:50.254 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-fuse 2026-02-20T11:28:50.568 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:33 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:50.652 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:50.652 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:50.653 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 86 k 2026-02-20T11:28:50.654 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 236 k 2026-02-20T11:28:50.654 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:28:51.050 INFO:teuthology.orchestra.run.trial086.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 218 kB/s | 86 kB 00:00 2026-02-20T11:28:51.050 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:51.051 INFO:teuthology.orchestra.run.trial086.stdout:Total 217 kB/s | 86 kB 00:00 2026-02-20T11:28:51.051 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:28:51.055 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:28:51.055 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:28:51.086 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:28:51.086 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:28:51.138 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:28:51.154 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:51.242 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:51.302 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:51.302 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:51.302 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:28:51.302 INFO:teuthology.orchestra.run.trial086.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:51.302 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:51.302 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:51.330 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-mirror 2026-02-20T11:28:51.643 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:34 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:51.727 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 2.6 M 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 11 M 2026-02-20T11:28:51.728 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:28:54.097 INFO:teuthology.orchestra.run.trial086.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.1 MB/s | 2.6 MB 00:02 2026-02-20T11:28:54.098 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:54.098 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.1 MB/s | 2.6 MB 00:02 2026-02-20T11:28:54.098 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:28:54.103 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:28:54.103 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:28:54.143 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:28:54.143 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:28:54.306 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:28:54.307 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:54.328 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:54.329 INFO:teuthology.orchestra.run.trial086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:54.329 INFO:teuthology.orchestra.run.trial086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:28:54.329 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:28:54.329 INFO:teuthology.orchestra.run.trial086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:28:54.329 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:54.616 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:54.617 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:54.617 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:28:54.617 INFO:teuthology.orchestra.run.trial086.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:54.617 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:54.617 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:54.645 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-nbd 2026-02-20T11:28:54.955 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:37 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:55.039 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:55.039 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:55.039 INFO:teuthology.orchestra.run.trial086.stdout: Package Architecture Version Repository Size 2026-02-20T11:28:55.039 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:55.039 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:28:55.039 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:28:55.039 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:55.040 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:28:55.040 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:55.040 INFO:teuthology.orchestra.run.trial086.stdout:Install 1 Package 2026-02-20T11:28:55.040 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:55.040 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 167 k 2026-02-20T11:28:55.040 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 496 k 2026-02-20T11:28:55.040 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:28:55.536 INFO:teuthology.orchestra.run.trial086.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 336 kB/s | 167 kB 00:00 2026-02-20T11:28:55.536 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:55.536 INFO:teuthology.orchestra.run.trial086.stdout:Total 335 kB/s | 167 kB 00:00 2026-02-20T11:28:55.536 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:28:55.541 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:28:55.541 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:28:55.574 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:28:55.574 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:28:55.638 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:28:55.654 INFO:teuthology.orchestra.run.trial086.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:55.736 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:55.796 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:28:55.796 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:55.797 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:28:55.797 INFO:teuthology.orchestra.run.trial086.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:55.797 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:55.797 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:55.823 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:28:56.140 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:39 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:56.205 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:28:56.224 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:56.225 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:28:56.225 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:28:56.245 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:28:56.556 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:02:39 ago on Fri 20 Feb 2026 11:26:17 AM UTC. 2026-02-20T11:28:56.640 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:28:56.641 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout: Package Arch Version Repo Size 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout:Installing: 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout:Installing weak dependencies: 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout:Transaction Summary 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout:================================================================================ 2026-02-20T11:28:56.642 INFO:teuthology.orchestra.run.trial086.stdout:Install 2 Packages 2026-02-20T11:28:56.643 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:28:56.643 INFO:teuthology.orchestra.run.trial086.stdout:Total download size: 445 M 2026-02-20T11:28:56.643 INFO:teuthology.orchestra.run.trial086.stdout:Installed size: 2.7 G 2026-02-20T11:28:56.643 INFO:teuthology.orchestra.run.trial086.stdout:Downloading Packages: 2026-02-20T11:29:03.151 INFO:teuthology.orchestra.run.trial086.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 1.9 MB/s | 12 MB 00:06 2026-02-20T11:33:51.029 INFO:teuthology.orchestra.run.trial046.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 1.4 MB/s | 433 MB 05:05 2026-02-20T11:33:51.036 INFO:teuthology.orchestra.run.trial046.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:33:51.036 INFO:teuthology.orchestra.run.trial046.stdout:Total 1.5 MB/s | 445 MB 05:05 2026-02-20T11:33:51.036 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction check 2026-02-20T11:33:51.036 INFO:teuthology.orchestra.run.trial046.stdout:Transaction check succeeded. 2026-02-20T11:33:51.036 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction test 2026-02-20T11:33:52.411 INFO:teuthology.orchestra.run.trial046.stdout:Transaction test succeeded. 2026-02-20T11:33:52.412 INFO:teuthology.orchestra.run.trial046.stdout:Running transaction 2026-02-20T11:33:55.999 INFO:teuthology.orchestra.run.trial046.stdout: Preparing : 1/1 2026-02-20T11:34:15.047 INFO:teuthology.orchestra.run.trial086.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 1.4 MB/s | 433 MB 05:18 2026-02-20T11:34:15.048 INFO:teuthology.orchestra.run.trial086.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:34:15.049 INFO:teuthology.orchestra.run.trial086.stdout:Total 1.4 MB/s | 445 MB 05:18 2026-02-20T11:34:15.050 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction check 2026-02-20T11:34:15.054 INFO:teuthology.orchestra.run.trial086.stdout:Transaction check succeeded. 2026-02-20T11:34:15.055 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction test 2026-02-20T11:34:16.431 INFO:teuthology.orchestra.run.trial086.stdout:Transaction test succeeded. 2026-02-20T11:34:16.431 INFO:teuthology.orchestra.run.trial086.stdout:Running transaction 2026-02-20T11:34:18.267 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:34:18.284 INFO:teuthology.orchestra.run.trial046.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:20.101 INFO:teuthology.orchestra.run.trial086.stdout: Preparing : 1/1 2026-02-20T11:34:20.285 INFO:teuthology.orchestra.run.trial046.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:20.285 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:34:20.344 INFO:teuthology.orchestra.run.trial046.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:20.344 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:34:20.344 INFO:teuthology.orchestra.run.trial046.stdout:Installed: 2026-02-20T11:34:20.345 INFO:teuthology.orchestra.run.trial046.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:34:20.345 INFO:teuthology.orchestra.run.trial046.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:34:20.345 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:34:20.345 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:34:20.424 DEBUG:teuthology.parallel:result is None 2026-02-20T11:34:42.783 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:34:42.801 INFO:teuthology.orchestra.run.trial086.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:44.810 INFO:teuthology.orchestra.run.trial086.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:44.811 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:34:44.871 INFO:teuthology.orchestra.run.trial086.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:44.871 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:34:44.871 INFO:teuthology.orchestra.run.trial086.stdout:Installed: 2026-02-20T11:34:44.871 INFO:teuthology.orchestra.run.trial086.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:34:44.872 INFO:teuthology.orchestra.run.trial086.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:34:44.872 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:34:44.872 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:34:44.952 DEBUG:teuthology.parallel:result is None 2026-02-20T11:34:44.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:34:45.077 DEBUG:teuthology.orchestra.run.trial046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:34:45.099 INFO:teuthology.orchestra.run.trial046.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:34:45.099 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:34:45.100 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:34:45.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:34:45.242 DEBUG:teuthology.orchestra.run.trial086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:34:45.263 INFO:teuthology.orchestra.run.trial086.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:34:45.263 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:34:45.263 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:34:45.264 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T11:34:45.264 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:34:45.264 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:34:45.291 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:34:45.292 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:34:45.329 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T11:34:45.329 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:34:45.330 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:34:45.355 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:34:45.419 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:34:45.420 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:34:45.446 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:34:45.510 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T11:34:45.511 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:34:45.511 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:34:45.536 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:34:45.601 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:34:45.601 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:34:45.627 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:34:45.690 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T11:34:45.690 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:34:45.690 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:34:45.716 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:34:45.782 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:34:45.782 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:34:45.807 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:34:45.871 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T11:34:45.888 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T11:34:45.889 DEBUG:teuthology.orchestra.run.trial046:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:34:45.889 DEBUG:teuthology.orchestra.run.trial086:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:34:45.892 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial046.front.sepia.ceph.com 2026-02-20T11:34:45.892 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:34:45.913 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial086.front.sepia.ceph.com 2026-02-20T11:34:45.913 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:34:45.943 DEBUG:teuthology.parallel:result is None 2026-02-20T11:34:45.963 DEBUG:teuthology.parallel:result is None 2026-02-20T11:34:45.963 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:34:45.978 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:34:45.978 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:34:45.978 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:34:45.978 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:34:45.987 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:34:45.987 INFO:teuthology.task.install:extra packages: [] 2026-02-20T11:34:45.987 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:34:45.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:34:45.989 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:34:45.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:34:46.177 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:34:46.177 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:34:46.188 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:34:46.188 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:34:46.543 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:34:46.544 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:34:46.544 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:34:46.568 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:34:46.569 DEBUG:teuthology.orchestra.run.trial046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:34:46.574 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:34:46.574 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:34:46.574 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:34:46.599 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:34:46.600 DEBUG:teuthology.orchestra.run.trial086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:34:46.632 DEBUG:teuthology.orchestra.run.trial046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:34:46.663 DEBUG:teuthology.orchestra.run.trial086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:34:46.698 DEBUG:teuthology.orchestra.run.trial046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:34:46.727 DEBUG:teuthology.orchestra.run.trial086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:34:46.755 INFO:teuthology.orchestra.run.trial046.stdout:check_obsoletes = 1 2026-02-20T11:34:46.765 DEBUG:teuthology.orchestra.run.trial046:> sudo yum clean all 2026-02-20T11:34:46.782 INFO:teuthology.orchestra.run.trial086.stdout:check_obsoletes = 1 2026-02-20T11:34:46.791 DEBUG:teuthology.orchestra.run.trial086:> sudo yum clean all 2026-02-20T11:34:46.928 INFO:teuthology.orchestra.run.trial046.stdout:56 files removed 2026-02-20T11:34:46.944 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-radosgw 2026-02-20T11:34:46.951 INFO:teuthology.orchestra.run.trial086.stdout:56 files removed 2026-02-20T11:34:46.964 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-radosgw 2026-02-20T11:34:47.794 INFO:teuthology.orchestra.run.trial046.stdout:ceph packages for x86_64 134 kB/s | 94 kB 00:00 2026-02-20T11:34:48.248 INFO:teuthology.orchestra.run.trial086.stdout:ceph packages for x86_64 83 kB/s | 94 kB 00:01 2026-02-20T11:34:48.722 INFO:teuthology.orchestra.run.trial046.stdout:ceph noarch packages 27 kB/s | 24 kB 00:00 2026-02-20T11:34:48.869 INFO:teuthology.orchestra.run.trial086.stdout:ceph noarch packages 41 kB/s | 24 kB 00:00 2026-02-20T11:34:49.272 INFO:teuthology.orchestra.run.trial046.stdout:ceph source packages 3.9 kB/s | 2.1 kB 00:00 2026-02-20T11:34:49.432 INFO:teuthology.orchestra.run.trial086.stdout:ceph source packages 3.8 kB/s | 2.1 kB 00:00 2026-02-20T11:34:50.207 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-20T11:34:50.229 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.9 MB 00:00 2026-02-20T11:34:53.415 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T11:34:53.885 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 27 MB 00:03 2026-02-20T11:34:57.061 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 7.8 MB 00:01 2026-02-20T11:34:58.097 INFO:teuthology.orchestra.run.trial086.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 20 kB 00:00 2026-02-20T11:34:58.662 INFO:teuthology.orchestra.run.trial086.stdout:Extra Packages for Enterprise Linux 41 MB/s | 20 MB 00:00 2026-02-20T11:35:01.901 INFO:teuthology.orchestra.run.trial086.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-20T11:35:02.583 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - CRB 1.2 MB/s | 7.8 MB 00:06 2026-02-20T11:35:03.083 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:03.102 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:03.103 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:03.103 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:03.128 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-test 2026-02-20T11:35:03.437 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:03.462 INFO:teuthology.orchestra.run.trial046.stdout:CentOS Stream 9 - Extras packages 139 kB/s | 20 kB 00:00 2026-02-20T11:35:03.503 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:03.522 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:03.522 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:03.522 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:03.544 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph 2026-02-20T11:35:03.858 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:03.923 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:03.941 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:03.942 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:03.942 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:03.964 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-base 2026-02-20T11:35:04.169 INFO:teuthology.orchestra.run.trial046.stdout:Extra Packages for Enterprise Linux 32 MB/s | 20 MB 00:00 2026-02-20T11:35:04.274 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:04.339 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:04.357 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:04.358 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:04.358 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:04.379 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install cephadm 2026-02-20T11:35:04.687 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:04.753 INFO:teuthology.orchestra.run.trial086.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:04.772 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:04.773 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:04.773 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:04.795 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:35:05.110 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:05.175 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:05.193 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:05.194 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:05.194 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:05.215 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr 2026-02-20T11:35:05.529 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:05.594 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:05.612 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:05.613 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:05.613 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:05.634 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:35:05.951 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:06.016 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:06.034 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:06.035 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:06.035 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:06.056 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:35:06.369 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:06.433 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:06.452 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:06.452 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:06.452 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:06.473 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:35:06.784 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:06.850 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:06.868 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:06.869 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:06.869 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:06.891 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:35:07.206 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:07.271 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:07.289 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:07.290 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:07.290 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:07.312 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd 2026-02-20T11:35:07.375 INFO:teuthology.orchestra.run.trial046.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-20T11:35:07.622 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:07.687 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:07.705 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:07.706 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:07.706 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:07.727 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-osd-classic 2026-02-20T11:35:08.045 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:08.111 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:08.129 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:08.130 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:08.130 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:08.153 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-fuse 2026-02-20T11:35:08.466 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:08.530 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:08.549 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:08.550 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:08.550 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:08.550 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:08.568 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:08.569 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:08.569 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:08.571 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install ceph-volume 2026-02-20T11:35:08.593 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-test 2026-02-20T11:35:08.890 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:08.899 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:08.956 INFO:teuthology.orchestra.run.trial086.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:08.964 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:08.975 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:08.975 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:08.975 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:08.982 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:08.983 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:08.983 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:08.996 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados-devel 2026-02-20T11:35:09.003 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph 2026-02-20T11:35:09.310 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:09.312 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:09.375 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:09.377 INFO:teuthology.orchestra.run.trial086.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:09.394 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:09.395 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:09.395 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:09.396 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:09.396 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:09.397 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:09.416 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-base 2026-02-20T11:35:09.418 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs2 2026-02-20T11:35:09.727 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:09.727 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:09.791 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:09.792 INFO:teuthology.orchestra.run.trial086.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:09.809 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:09.810 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:09.810 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:09.810 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:09.811 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:09.811 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:09.831 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install cephadm 2026-02-20T11:35:09.832 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install libcephfs-devel 2026-02-20T11:35:10.139 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:10.145 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:10.206 INFO:teuthology.orchestra.run.trial046.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:10.209 INFO:teuthology.orchestra.run.trial086.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:10.225 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:10.226 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:10.226 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:10.228 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:10.229 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:10.229 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:10.247 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:35:10.250 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librados2 2026-02-20T11:35:10.559 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:10.562 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:10.624 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:10.628 INFO:teuthology.orchestra.run.trial086.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:10.642 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:10.643 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:10.643 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:10.646 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:10.647 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:10.647 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:10.665 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr 2026-02-20T11:35:10.669 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install librbd1 2026-02-20T11:35:10.976 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:10.977 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:11.041 INFO:teuthology.orchestra.run.trial086.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:11.042 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:11.059 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:11.060 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:11.060 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:11.061 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:11.061 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:11.061 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:11.081 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rados 2026-02-20T11:35:11.083 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:35:11.394 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:11.401 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:11.458 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:11.466 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:11.476 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:11.477 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:11.477 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:11.485 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:11.486 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:11.486 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:11.498 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:35:11.508 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rgw 2026-02-20T11:35:11.816 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:11.822 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:11.881 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:11.886 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:11.900 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:11.900 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:11.901 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:11.905 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:11.906 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:11.906 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:11.922 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:35:11.927 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-cephfs 2026-02-20T11:35:12.237 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:12.238 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:12.302 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:12.303 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:12.321 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:12.322 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:12.322 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:12.322 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:12.322 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:12.322 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:12.343 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:35:12.345 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install python3-rbd 2026-02-20T11:35:12.652 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:12.667 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:12.717 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:12.732 INFO:teuthology.orchestra.run.trial086.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:12.735 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:12.736 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:12.736 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:12.751 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:12.751 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:12.751 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:12.757 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd 2026-02-20T11:35:12.774 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-fuse 2026-02-20T11:35:13.068 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:13.084 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:13.133 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:13.148 INFO:teuthology.orchestra.run.trial086.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:13.151 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:13.152 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:13.152 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:13.167 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:13.168 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:13.168 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:13.172 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-osd-classic 2026-02-20T11:35:13.190 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-mirror 2026-02-20T11:35:13.488 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:13.506 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:13.553 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:13.571 INFO:teuthology.orchestra.run.trial086.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:13.572 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:13.572 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:13.573 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:13.590 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:13.591 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:13.591 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:13.593 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-fuse 2026-02-20T11:35:13.612 DEBUG:teuthology.orchestra.run.trial086:> sudo yum -y install rbd-nbd 2026-02-20T11:35:13.897 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:13.925 INFO:teuthology.orchestra.run.trial086.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:35:01 AM UTC. 2026-02-20T11:35:13.962 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:13.981 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:13.981 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:13.982 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial086.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:14.003 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install ceph-volume 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial086.stdout:Dependencies resolved. 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial086.stdout:Nothing to do. 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial086.stdout:Complete! 2026-02-20T11:35:14.034 DEBUG:teuthology.parallel:result is None 2026-02-20T11:35:14.314 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:14.379 INFO:teuthology.orchestra.run.trial046.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:14.398 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:14.399 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:14.399 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:14.421 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librados-devel 2026-02-20T11:35:14.737 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:14.801 INFO:teuthology.orchestra.run.trial046.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:14.820 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:14.820 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:14.820 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:14.842 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install libcephfs2 2026-02-20T11:35:15.155 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:15.220 INFO:teuthology.orchestra.run.trial046.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:15.239 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:15.239 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:15.239 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:15.261 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install libcephfs-devel 2026-02-20T11:35:15.576 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:15.641 INFO:teuthology.orchestra.run.trial046.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:15.659 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:15.660 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:15.660 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:15.682 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librados2 2026-02-20T11:35:15.989 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:16.055 INFO:teuthology.orchestra.run.trial046.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:16.073 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:16.074 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:16.074 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:16.096 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install librbd1 2026-02-20T11:35:16.406 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:16.471 INFO:teuthology.orchestra.run.trial046.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:16.490 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:16.491 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:16.491 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:16.513 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rados 2026-02-20T11:35:16.825 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:16.890 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:16.909 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:16.910 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:16.910 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:16.932 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rgw 2026-02-20T11:35:17.248 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:17.313 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:17.332 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:17.333 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:17.333 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:17.354 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-cephfs 2026-02-20T11:35:17.664 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:17.729 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:17.748 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:17.748 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:17.749 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:17.770 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install python3-rbd 2026-02-20T11:35:18.082 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:18.147 INFO:teuthology.orchestra.run.trial046.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:18.166 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:18.167 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:18.167 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:18.188 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-fuse 2026-02-20T11:35:18.495 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:18.560 INFO:teuthology.orchestra.run.trial046.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:18.579 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:18.579 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:18.579 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:18.601 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-mirror 2026-02-20T11:35:18.913 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:18.977 INFO:teuthology.orchestra.run.trial046.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:18.996 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:18.997 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:18.997 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:19.019 DEBUG:teuthology.orchestra.run.trial046:> sudo yum -y install rbd-nbd 2026-02-20T11:35:19.329 INFO:teuthology.orchestra.run.trial046.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:35:07 AM UTC. 2026-02-20T11:35:19.393 INFO:teuthology.orchestra.run.trial046.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:19.412 INFO:teuthology.orchestra.run.trial046.stdout:Dependencies resolved. 2026-02-20T11:35:19.412 INFO:teuthology.orchestra.run.trial046.stdout:Nothing to do. 2026-02-20T11:35:19.412 INFO:teuthology.orchestra.run.trial046.stdout:Complete! 2026-02-20T11:35:19.437 DEBUG:teuthology.parallel:result is None 2026-02-20T11:35:19.438 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:35:19.606 DEBUG:teuthology.orchestra.run.trial046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:35:19.627 INFO:teuthology.orchestra.run.trial046.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:35:19.627 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:35:19.627 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:35:19.630 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:35:19.780 DEBUG:teuthology.orchestra.run.trial086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:35:19.802 INFO:teuthology.orchestra.run.trial086.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:35:19.802 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:35:19.803 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:35:19.805 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-20T11:35:19.805 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T11:35:19.900 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T11:35:19.900 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod 777 /var/log/ceph 2026-02-20T11:35:19.902 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 777 /var/log/ceph 2026-02-20T11:35:19.926 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T11:35:19.926 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:35:19.968 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:35:19.991 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T11:35:19.991 DEBUG:teuthology.orchestra.run.trial046:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:35:20.032 DEBUG:teuthology.orchestra.run.trial086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:35:20.072 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T11:35:20.072 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T11:35:20.073 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517', 'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439', 'description': 'crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/snaps-few-objects}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '60517', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}}, 'owner': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1736, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '445d5c9ba18a4040e70e25303230c36c77773acb', 'targets': {'trial046.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG3h7C5vi7eDg2Sa3ddjF++HSiyXlHfr3CUVOacgQ/VTj0b1G5C5laCro/pWiDS+/oAIkEK9eSSDnFhKE0xSeT0=', 'trial086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIpPc0AOoYb3a/PhnLh5g3awsMCims0/Yb/ndGjDu/hVuTYQkVdhTKVzIjG5S3ijSoWGIZx/kXL5ae6eZ9c+W4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'rados': {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 0, 'delete': 50, 'read': 100, 'rollback': 0, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-20_10:21:31', 'tube': 'trial', 'user': 'jjperez', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T11:35:20.074 DEBUG:teuthology.orchestra.run.trial046:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:35:20.096 DEBUG:teuthology.orchestra.run.trial086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:35:20.114 DEBUG:teuthology.orchestra.run.trial046:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:35:20.153 DEBUG:teuthology.orchestra.run.trial086:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:35:20.178 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:20.178 DEBUG:teuthology.orchestra.run.trial046:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:35:20.232 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:35:20.233 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_1 2026-02-20T11:35:20.288 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:35:20.288 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:20.288 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 1298 Links: 1 2026-02-20T11:35:20.288 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:20.288 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:20.288 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-20 11:28:43.049618724 +0000 2026-02-20T11:35:20.288 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-20 11:26:32.959920102 +0000 2026-02-20T11:35:20.288 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-20 11:26:32.959920102 +0000 2026-02-20T11:35:20.288 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-20 11:26:32.959920102 +0000 2026-02-20T11:35:20.288 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:35:20.353 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-20T11:35:20.353 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-20T11:35:20.353 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000241337 s, 2.1 MB/s 2026-02-20T11:35:20.354 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:35:20.411 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_2 2026-02-20T11:35:20.467 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:35:20.467 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:20.467 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 1317 Links: 1 2026-02-20T11:35:20.467 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:20.467 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:20.467 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-20 11:28:43.049618724 +0000 2026-02-20T11:35:20.467 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-20 11:26:32.960920065 +0000 2026-02-20T11:35:20.467 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-20 11:26:32.960920065 +0000 2026-02-20T11:35:20.467 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-20 11:26:32.960920065 +0000 2026-02-20T11:35:20.468 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:35:20.529 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-20T11:35:20.529 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-20T11:35:20.529 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000204569 s, 2.5 MB/s 2026-02-20T11:35:20.530 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:35:20.586 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_3 2026-02-20T11:35:20.642 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:35:20.642 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:20.642 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-20T11:35:20.642 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:20.642 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:20.642 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-20 11:28:43.050618702 +0000 2026-02-20T11:35:20.642 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-20 11:26:32.959920102 +0000 2026-02-20T11:35:20.643 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-20 11:26:32.959920102 +0000 2026-02-20T11:35:20.643 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-20 11:26:32.959920102 +0000 2026-02-20T11:35:20.643 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:35:20.705 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-20T11:35:20.705 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-20T11:35:20.705 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000155578 s, 3.3 MB/s 2026-02-20T11:35:20.706 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:35:20.765 DEBUG:teuthology.orchestra.run.trial046:> stat /dev/vg_nvme/lv_4 2026-02-20T11:35:20.822 INFO:teuthology.orchestra.run.trial046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:35:20.822 INFO:teuthology.orchestra.run.trial046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:20.822 INFO:teuthology.orchestra.run.trial046.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-20T11:35:20.822 INFO:teuthology.orchestra.run.trial046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:20.823 INFO:teuthology.orchestra.run.trial046.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:20.823 INFO:teuthology.orchestra.run.trial046.stdout:Access: 2026-02-20 11:28:43.050618702 +0000 2026-02-20T11:35:20.823 INFO:teuthology.orchestra.run.trial046.stdout:Modify: 2026-02-20 11:26:32.959920102 +0000 2026-02-20T11:35:20.823 INFO:teuthology.orchestra.run.trial046.stdout:Change: 2026-02-20 11:26:32.959920102 +0000 2026-02-20T11:35:20.823 INFO:teuthology.orchestra.run.trial046.stdout: Birth: 2026-02-20 11:26:32.959920102 +0000 2026-02-20T11:35:20.823 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:35:20.885 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records in 2026-02-20T11:35:20.886 INFO:teuthology.orchestra.run.trial046.stderr:1+0 records out 2026-02-20T11:35:20.886 INFO:teuthology.orchestra.run.trial046.stderr:512 bytes copied, 0.000142253 s, 3.6 MB/s 2026-02-20T11:35:20.887 DEBUG:teuthology.orchestra.run.trial046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:35:20.943 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:20.943 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:35:20.943 DEBUG:teuthology.orchestra.run.trial086:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:35:20.960 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:35:20.960 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_1 2026-02-20T11:35:21.016 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:35:21.017 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:21.017 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-20T11:35:21.017 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:21.017 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:21.017 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-20 11:28:54.465083652 +0000 2026-02-20T11:35:21.017 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-20 11:26:33.746940204 +0000 2026-02-20T11:35:21.017 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-20 11:26:33.746940204 +0000 2026-02-20T11:35:21.017 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-20 11:26:33.746940204 +0000 2026-02-20T11:35:21.018 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:35:21.080 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-20T11:35:21.080 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-20T11:35:21.080 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000158895 s, 3.2 MB/s 2026-02-20T11:35:21.081 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:35:21.140 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_2 2026-02-20T11:35:21.196 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:35:21.196 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:21.197 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-20T11:35:21.197 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:21.197 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:21.197 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-20 11:28:54.466083615 +0000 2026-02-20T11:35:21.197 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-20 11:26:33.746940204 +0000 2026-02-20T11:35:21.197 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-20 11:26:33.746940204 +0000 2026-02-20T11:35:21.197 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-20 11:26:33.746940204 +0000 2026-02-20T11:35:21.197 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:35:21.259 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-20T11:35:21.259 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-20T11:35:21.259 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000143707 s, 3.6 MB/s 2026-02-20T11:35:21.261 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:35:21.319 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_3 2026-02-20T11:35:21.375 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:35:21.375 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:21.375 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1306 Links: 1 2026-02-20T11:35:21.375 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:21.375 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:21.375 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-20 11:28:54.466083615 +0000 2026-02-20T11:35:21.375 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-20 11:26:33.746940204 +0000 2026-02-20T11:35:21.376 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-20 11:26:33.746940204 +0000 2026-02-20T11:35:21.376 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-20 11:26:33.746940204 +0000 2026-02-20T11:35:21.376 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:35:21.437 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-20T11:35:21.437 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-20T11:35:21.437 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000151292 s, 3.4 MB/s 2026-02-20T11:35:21.438 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:35:21.495 DEBUG:teuthology.orchestra.run.trial086:> stat /dev/vg_nvme/lv_4 2026-02-20T11:35:21.552 INFO:teuthology.orchestra.run.trial086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:35:21.552 INFO:teuthology.orchestra.run.trial086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:21.553 INFO:teuthology.orchestra.run.trial086.stdout:Device: 6h/6d Inode: 1280 Links: 1 2026-02-20T11:35:21.553 INFO:teuthology.orchestra.run.trial086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:21.553 INFO:teuthology.orchestra.run.trial086.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:21.553 INFO:teuthology.orchestra.run.trial086.stdout:Access: 2026-02-20 11:28:54.466083615 +0000 2026-02-20T11:35:21.553 INFO:teuthology.orchestra.run.trial086.stdout:Modify: 2026-02-20 11:26:33.745940243 +0000 2026-02-20T11:35:21.553 INFO:teuthology.orchestra.run.trial086.stdout:Change: 2026-02-20 11:26:33.745940243 +0000 2026-02-20T11:35:21.553 INFO:teuthology.orchestra.run.trial086.stdout: Birth: 2026-02-20 11:26:33.745940243 +0000 2026-02-20T11:35:21.553 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:35:21.615 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records in 2026-02-20T11:35:21.616 INFO:teuthology.orchestra.run.trial086.stderr:1+0 records out 2026-02-20T11:35:21.616 INFO:teuthology.orchestra.run.trial086.stderr:512 bytes copied, 0.000148837 s, 3.4 MB/s 2026-02-20T11:35:21.617 DEBUG:teuthology.orchestra.run.trial086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:35:21.677 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:21.677 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial086.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T11:35:21.677 INFO:tasks.ceph:Generating config... 2026-02-20T11:35:21.679 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-20T11:35:21.680 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] osd delete sleep = 1 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] osd max backfills = 3 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2026-02-20T11:35:21.681 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-20T11:35:21.682 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2026-02-20T11:35:21.682 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2026-02-20T11:35:21.682 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-20T11:35:21.682 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2026-02-20T11:35:21.682 INFO:tasks.ceph:[osd] osd target transaction size = 5 2026-02-20T11:35:21.682 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-20T11:35:21.682 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-20T11:35:21.682 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:35:21.682 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-20T11:35:21.682 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-20T11:35:21.682 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-20T11:35:21.682 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-20T11:35:21.683 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-20T11:35:21.683 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-20T11:35:21.683 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2026-02-20T11:35:21.683 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2026-02-20T11:35:21.683 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T11:35:21.683 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T11:35:21.683 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-20T11:35:21.683 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-20T11:35:21.683 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-20T11:35:21.683 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-20T11:35:21.683 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-20T11:35:21.683 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-20T11:35:21.684 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-20T11:35:21.684 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-20T11:35:21.684 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-20T11:35:21.684 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T11:35:21.684 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T11:35:21.726 INFO:teuthology.orchestra.run.trial046.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T11:35:21.729 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T11:35:21.819 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:35:21.846 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.46')] 2026-02-20T11:35:21.846 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.46', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-20T11:35:21.848 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:21.848 DEBUG:teuthology.orchestra.run.trial046:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:35:21.905 DEBUG:teuthology.orchestra.run.trial046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.46 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:21.985 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:21.983+0000 7f9642e2ef40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:21.985 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:21.983+0000 7f9642e2ef40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:21.985 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:21.983+0000 7f9642e2ef40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:21.987 INFO:teuthology.orchestra.run.trial046.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:21.987 INFO:teuthology.orchestra.run.trial046.stdout:monmaptool: generated fsid 6a7e41b7-6f36-42a8-877b-32f239584843 2026-02-20T11:35:21.987 INFO:teuthology.orchestra.run.trial046.stdout:setting min_mon_release = tentacle 2026-02-20T11:35:21.987 INFO:teuthology.orchestra.run.trial046.stdout:epoch 0 2026-02-20T11:35:21.987 INFO:teuthology.orchestra.run.trial046.stdout:fsid 6a7e41b7-6f36-42a8-877b-32f239584843 2026-02-20T11:35:21.987 INFO:teuthology.orchestra.run.trial046.stdout:last_changed 2026-02-20T11:35:21.984624+0000 2026-02-20T11:35:21.987 INFO:teuthology.orchestra.run.trial046.stdout:created 2026-02-20T11:35:21.984624+0000 2026-02-20T11:35:21.987 INFO:teuthology.orchestra.run.trial046.stdout:min_mon_release 20 (tentacle) 2026-02-20T11:35:21.987 INFO:teuthology.orchestra.run.trial046.stdout:election_strategy: 1 2026-02-20T11:35:21.988 INFO:teuthology.orchestra.run.trial046.stdout:0: [v2:10.20.193.46:3300/0,v1:10.20.193.46:6789/0] mon.a 2026-02-20T11:35:21.988 INFO:teuthology.orchestra.run.trial046.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T11:35:21.988 DEBUG:teuthology.orchestra.run.trial046:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:35:22.044 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6a7e41b7-6f36-42a8-877b-32f239584843... 2026-02-20T11:35:22.045 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:35:22.086 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:35:22.124 INFO:teuthology.orchestra.run.trial046.stdout:[global] 2026-02-20T11:35:22.124 INFO:teuthology.orchestra.run.trial046.stdout: chdir = "" 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: auth supported = cephx 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: filestore xattr use omap = true 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: mon clock drift allowed = 1.000 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: osd crush chooseleaf type = 0 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: auth debug = true 2026-02-20T11:35:22.125 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: ms die on old message = true 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: ms die on bug = true 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: mon pg warn max object skew = 0 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: osd pool default size = 2 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.126 INFO:teuthology.orchestra.run.trial046.stdout: mon osd allow primary affinity = true 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: mon osd allow pg remap = true 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on no sortbitwise = false 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: mon warn on too few osds = false 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: mon_allow_pool_size_one = true 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:35:22.127 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: osd default data pool replay window = 5 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: mon allow pool delete = true 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: mon cluster log file level = debug 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: debug asserts on shutdown = true 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: mon health detail to clog = false 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: mon host = 10.20.193.46 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: ms client mode = crc 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: ms cluster mode = crc 2026-02-20T11:35:22.128 INFO:teuthology.orchestra.run.trial046.stdout: ms mon client mode = crc 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: ms mon cluster mode = crc 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: ms mon service mode = crc 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: ms service mode = crc 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: osd_pool_default_min_size = 2 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: osd_pool_default_size = 3 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: fsid = 6a7e41b7-6f36-42a8-877b-32f239584843 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout:[osd] 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: osd journal size = 100 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: osd scrub load threshold = 5.0 2026-02-20T11:35:22.129 INFO:teuthology.orchestra.run.trial046.stdout: osd scrub max interval = 120 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd mclock skip benchmark = true 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd recover clone overlap = true 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd recovery max chunk = 1048576 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd debug shutdown = true 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd debug op order = true 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd debug verify stray on activate = true 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd debug trim objects = true 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd open classes on start = true 2026-02-20T11:35:22.130 INFO:teuthology.orchestra.run.trial046.stdout: osd debug pg log writeout = true 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: osd map max advance = 10 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: journal zero on create = true 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: filestore apply finisher threads = 3 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.131 INFO:teuthology.orchestra.run.trial046.stdout: bdev debug aio = true 2026-02-20T11:35:22.132 INFO:teuthology.orchestra.run.trial046.stdout: osd debug misdirected ops = true 2026-02-20T11:35:22.132 INFO:teuthology.orchestra.run.trial046.stdout: debug monc = 20 2026-02-20T11:35:22.132 INFO:teuthology.orchestra.run.trial046.stdout: crimson cpu num = 4 2026-02-20T11:35:22.132 INFO:teuthology.orchestra.run.trial046.stdout: crimson osd obc lru size = 10 2026-02-20T11:35:22.132 INFO:teuthology.orchestra.run.trial046.stdout: debug ms = 20 2026-02-20T11:35:22.132 INFO:teuthology.orchestra.run.trial046.stdout: debug osd = 20 2026-02-20T11:35:22.132 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore = 20 2026-02-20T11:35:22.132 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore backref = 20 2026-02-20T11:35:22.132 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore cache = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore cleaner = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore device = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore epm = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore fixedkv tree = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore journal = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore lba = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore odata = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore omap = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore onode = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore t = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: debug seastore tm = 20 2026-02-20T11:35:22.133 INFO:teuthology.orchestra.run.trial046.stdout: osd blocked scrub grace period = 3600 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: osd debug reject backfill probability = 0.3 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: osd delete sleep = 1 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: osd max backfills = 3 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: osd max markdown count = 1000 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: osd objectstore = seastore 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: osd scrub min interval = 60 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: osd shutdown pgref assert = True 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: osd snap trim sleep = 2 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: osd target transaction size = 5 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:35:22.134 INFO:teuthology.orchestra.run.trial046.stdout: seastore max concurrent transactions = 8 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout:[mgr] 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout: debug ms = 1 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout: debug mgr = 20 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout: debug mon = 20 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout: debug auth = 20 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout: mgr/telemetry/nag = false 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.135 INFO:teuthology.orchestra.run.trial046.stdout:[mon] 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: debug ms = 1 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: debug mon = 20 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: debug paxos = 20 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: debug auth = 20 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: mon data avail warn = 5 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: mon mgr mkfs grace = 240 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: mon osd reporter subtree level = osd 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: mon osd prime pg temp = true 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:35:22.136 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: # 1m isn't quite enough 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:35:22.137 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: mon min osdmap epochs = 50 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: mon osdmap full prune interval = 2 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: mon osdmap full prune min = 15 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: mon osdmap full prune txsize = 2 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: osd pool default crimson = True 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: paxos service trim min = 10 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout:[client] 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: rgw cache enabled = true 2026-02-20T11:35:22.138 INFO:teuthology.orchestra.run.trial046.stdout: rgw enable ops log = true 2026-02-20T11:35:22.139 INFO:teuthology.orchestra.run.trial046.stdout: rgw enable usage log = true 2026-02-20T11:35:22.139 INFO:teuthology.orchestra.run.trial046.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:35:22.139 INFO:teuthology.orchestra.run.trial046.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:35:22.139 INFO:teuthology.orchestra.run.trial046.stdout:[mon.a] 2026-02-20T11:35:22.141 INFO:teuthology.orchestra.run.trial086.stdout:[global] 2026-02-20T11:35:22.141 INFO:teuthology.orchestra.run.trial086.stdout: chdir = "" 2026-02-20T11:35:22.141 INFO:teuthology.orchestra.run.trial086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:35:22.141 INFO:teuthology.orchestra.run.trial086.stdout: auth supported = cephx 2026-02-20T11:35:22.141 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: filestore xattr use omap = true 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: mon clock drift allowed = 1.000 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: osd crush chooseleaf type = 0 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: auth debug = true 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: ms die on old message = true 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: ms die on bug = true 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.142 INFO:teuthology.orchestra.run.trial086.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: mon pg warn max object skew = 0 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: osd pool default size = 2 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: mon osd allow primary affinity = true 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: mon osd allow pg remap = true 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on no sortbitwise = false 2026-02-20T11:35:22.143 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: mon warn on too few osds = false 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: mon_allow_pool_size_one = true 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: osd default data pool replay window = 5 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: mon allow pool delete = true 2026-02-20T11:35:22.144 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: mon cluster log file level = debug 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: debug asserts on shutdown = true 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: mon health detail to clog = false 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: mon host = 10.20.193.46 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: ms client mode = crc 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: ms cluster mode = crc 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: ms mon client mode = crc 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: ms mon cluster mode = crc 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: ms mon service mode = crc 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: ms service mode = crc 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: osd_pool_default_min_size = 2 2026-02-20T11:35:22.145 INFO:teuthology.orchestra.run.trial086.stdout: osd_pool_default_size = 3 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: fsid = 6a7e41b7-6f36-42a8-877b-32f239584843 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout:[osd] 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: osd journal size = 100 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: osd scrub load threshold = 5.0 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: osd scrub max interval = 120 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: osd mclock skip benchmark = true 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: osd recover clone overlap = true 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: osd recovery max chunk = 1048576 2026-02-20T11:35:22.146 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: osd debug shutdown = true 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: osd debug op order = true 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: osd debug verify stray on activate = true 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: osd debug trim objects = true 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: osd open classes on start = true 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: osd debug pg log writeout = true 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: osd map max advance = 10 2026-02-20T11:35:22.147 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: journal zero on create = true 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: filestore apply finisher threads = 3 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: bdev debug aio = true 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: osd debug misdirected ops = true 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: debug monc = 20 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: crimson cpu num = 4 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: crimson osd obc lru size = 10 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 20 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: debug osd = 20 2026-02-20T11:35:22.148 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore backref = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore cache = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore cleaner = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore device = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore epm = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore fixedkv tree = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore journal = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore lba = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore odata = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore omap = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore onode = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore t = 20 2026-02-20T11:35:22.149 INFO:teuthology.orchestra.run.trial086.stdout: debug seastore tm = 20 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd blocked scrub grace period = 3600 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd debug reject backfill probability = 0.3 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd delete sleep = 1 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd max backfills = 3 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd max markdown count = 1000 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd objectstore = seastore 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd scrub min interval = 60 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd shutdown pgref assert = True 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd snap trim sleep = 2 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: osd target transaction size = 5 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: seastore max concurrent transactions = 8 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.150 INFO:teuthology.orchestra.run.trial086.stdout:[mgr] 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 1 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: debug mgr = 20 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: debug mon = 20 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: debug auth = 20 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: mgr/telemetry/nag = false 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout:[mon] 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: debug ms = 1 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: debug mon = 20 2026-02-20T11:35:22.151 INFO:teuthology.orchestra.run.trial086.stdout: debug paxos = 20 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: debug auth = 20 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: mon data avail warn = 5 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: mon mgr mkfs grace = 240 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: mon osd reporter subtree level = osd 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: mon osd prime pg temp = true 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.152 INFO:teuthology.orchestra.run.trial086.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: # 1m isn't quite enough 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: mon min osdmap epochs = 50 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: mon osdmap full prune interval = 2 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: mon osdmap full prune min = 15 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: mon osdmap full prune txsize = 2 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: osd pool default crimson = True 2026-02-20T11:35:22.153 INFO:teuthology.orchestra.run.trial086.stdout: paxos service trim min = 10 2026-02-20T11:35:22.154 INFO:teuthology.orchestra.run.trial086.stdout: 2026-02-20T11:35:22.154 INFO:teuthology.orchestra.run.trial086.stdout:[client] 2026-02-20T11:35:22.154 INFO:teuthology.orchestra.run.trial086.stdout: rgw cache enabled = true 2026-02-20T11:35:22.154 INFO:teuthology.orchestra.run.trial086.stdout: rgw enable ops log = true 2026-02-20T11:35:22.154 INFO:teuthology.orchestra.run.trial086.stdout: rgw enable usage log = true 2026-02-20T11:35:22.154 INFO:teuthology.orchestra.run.trial086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:35:22.154 INFO:teuthology.orchestra.run.trial086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:35:22.154 INFO:teuthology.orchestra.run.trial086.stdout:[mon.a] 2026-02-20T11:35:22.154 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T11:35:22.155 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T11:35:22.231 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T11:35:22.231 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:22.231 DEBUG:teuthology.orchestra.run.trial046:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T11:35:22.248 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:22.249 DEBUG:teuthology.orchestra.run.trial046:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T11:35:22.307 INFO:tasks.ceph:Sending monmap to node ubuntu@trial046.front.sepia.ceph.com 2026-02-20T11:35:22.307 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:22.307 DEBUG:teuthology.orchestra.run.trial046:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:35:22.307 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:35:22.380 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:22.380 DEBUG:teuthology.orchestra.run.trial046:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:22.437 INFO:tasks.ceph:Sending monmap to node ubuntu@trial086.front.sepia.ceph.com 2026-02-20T11:35:22.437 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:35:22.437 DEBUG:teuthology.orchestra.run.trial086:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:35:22.437 DEBUG:teuthology.orchestra.run.trial086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:35:22.471 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:35:22.472 DEBUG:teuthology.orchestra.run.trial086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:22.528 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T11:35:22.528 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T11:35:22.528 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:35:22.617 INFO:teuthology.orchestra.run.trial086.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:35:22.620 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T11:35:22.621 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T11:35:22.621 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T11:35:22.663 INFO:teuthology.orchestra.run.trial046.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T11:35:22.675 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-20T11:35:22.718 INFO:teuthology.orchestra.run.trial086.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-20T11:35:22.729 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T11:35:22.730 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial046.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial086.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T11:35:22.730 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T11:35:22.757 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:22.757 INFO:tasks.ceph:role: osd.0 2026-02-20T11:35:22.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial046.front.sepia.ceph.com 2026-02-20T11:35:22.757 DEBUG:teuthology.orchestra.run.trial046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:35:22.822 INFO:teuthology.orchestra.run.trial046.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:35:22.822 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:35:22.822 INFO:teuthology.orchestra.run.trial046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:35:22.823 INFO:teuthology.orchestra.run.trial046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:35:22.823 INFO:teuthology.orchestra.run.trial046.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:35:22.823 INFO:teuthology.orchestra.run.trial046.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:35:22.823 INFO:teuthology.orchestra.run.trial046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:35:22.823 INFO:teuthology.orchestra.run.trial046.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:35:22.823 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:35:22.823 INFO:teuthology.orchestra.run.trial046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:35:23.408 INFO:teuthology.orchestra.run.trial046.stdout:Discarding blocks...Done. 2026-02-20T11:35:23.410 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial046.front.sepia.ceph.com -o noatime 2026-02-20T11:35:23.410 DEBUG:teuthology.orchestra.run.trial046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T11:35:23.483 DEBUG:teuthology.orchestra.run.trial046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T11:35:23.557 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T11:35:23.623 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:23.624 INFO:tasks.ceph:role: osd.1 2026-02-20T11:35:23.624 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial046.front.sepia.ceph.com 2026-02-20T11:35:23.624 DEBUG:teuthology.orchestra.run.trial046:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:35:23.687 INFO:teuthology.orchestra.run.trial046.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:35:23.687 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:35:23.687 INFO:teuthology.orchestra.run.trial046.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:35:23.687 INFO:teuthology.orchestra.run.trial046.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:35:23.687 INFO:teuthology.orchestra.run.trial046.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:35:23.688 INFO:teuthology.orchestra.run.trial046.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:35:23.688 INFO:teuthology.orchestra.run.trial046.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:35:23.688 INFO:teuthology.orchestra.run.trial046.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:35:23.688 INFO:teuthology.orchestra.run.trial046.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:35:23.688 INFO:teuthology.orchestra.run.trial046.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:35:24.259 INFO:teuthology.orchestra.run.trial046.stdout:Discarding blocks...Done. 2026-02-20T11:35:24.262 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial046.front.sepia.ceph.com -o noatime 2026-02-20T11:35:24.262 DEBUG:teuthology.orchestra.run.trial046:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T11:35:24.331 DEBUG:teuthology.orchestra.run.trial046:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T11:35:24.398 DEBUG:teuthology.orchestra.run.trial046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:24.549 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:35:24.604 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:24,604 seastar - Reactor backend: linux-aio 2026-02-20T11:35:24.619 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:24,619 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:24.619 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:24,619 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:24.622 INFO:teuthology.orchestra.run.trial046.stderr:==39116==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:24.677 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:24,677 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:35:24.677 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:24,677 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:35:24.677 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:24,677 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:35:24.677 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:24,677 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:35:24.678 INFO:teuthology.orchestra.run.trial046.stderr:DEBUG 2026-02-20 11:35:24,677 [shard 0:main] seastar - reactor::drain 2026-02-20T11:35:26.728 INFO:teuthology.orchestra.run.trial046.stderr:----------------------------------------------------- 2026-02-20T11:35:26.728 INFO:teuthology.orchestra.run.trial046.stderr:Suppressions used: 2026-02-20T11:35:26.728 INFO:teuthology.orchestra.run.trial046.stderr: count bytes template 2026-02-20T11:35:26.729 INFO:teuthology.orchestra.run.trial046.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:26.729 INFO:teuthology.orchestra.run.trial046.stderr:----------------------------------------------------- 2026-02-20T11:35:26.729 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-20T11:35:26.747 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:35:26.747 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:35:26.793 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:35:26.793 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:35:26.799 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:26,799 seastar - Reactor backend: linux-aio 2026-02-20T11:35:26.812 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:26,811 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:26.812 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:26,811 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:26.815 INFO:teuthology.orchestra.run.trial046.stderr:==39114==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:26.815 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:26,815 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:35:26.873 INFO:teuthology.orchestra.run.trial046.stderr:DEBUG 2026-02-20 11:35:26,872 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:35:26.958 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119513 /lib64/libasan.so.8+0xef94b 0x320034c 0x3200526 0x32007dd 0x32008d2 0x6f45c32 0x7b9c9b3 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:26.959 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e20ca8 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:26.959 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc08 /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x157c7 0x10a3723 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:26.991 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cbf3 /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x359d229 0x9e30705 0x9e3080d 0x9ef7d44 0x9ef7ed9 0x9ef826b 0x9ef9851 0x9efab6c 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f76cf2 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:27.029 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:27.033 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b377 /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7ba136a 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f76cf2 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.034 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119134 /lib64/libasan.so.8+0xebbf /lib64/libasan.so.8+0xec776 0xcc3105 0x7f5d9ec 0x7f640c0 0x7fb45b4 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.098 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d89b2 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.100 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.100 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d83ab 0x7d69b2a 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.229 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x31fb048 0x9e1e9f0 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.230 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x359d229 0x9e30705 0x9e3080d 0x9ef7d44 0x9ef7ed9 0x9ef826b 0x9ef9851 0x9efab6c 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.230 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb047e /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.312 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:27.327 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x297f446 0x29d89ca 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.328 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1521e 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:27.329 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:29.493 INFO:teuthology.orchestra.run.trial046.stderr:----------------------------------------------------- 2026-02-20T11:35:29.493 INFO:teuthology.orchestra.run.trial046.stderr:Suppressions used: 2026-02-20T11:35:29.493 INFO:teuthology.orchestra.run.trial046.stderr: count bytes template 2026-02-20T11:35:29.493 INFO:teuthology.orchestra.run.trial046.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:29.494 INFO:teuthology.orchestra.run.trial046.stderr:----------------------------------------------------- 2026-02-20T11:35:29.494 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-20T11:35:29.529 DEBUG:teuthology.orchestra.run.trial046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T11:35:29.555 DEBUG:teuthology.orchestra.run.trial046:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:29.710 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:35:29.763 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:29,762 seastar - Reactor backend: linux-aio 2026-02-20T11:35:29.773 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:29,772 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:29.773 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:29,772 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:29.775 INFO:teuthology.orchestra.run.trial046.stderr:==39182==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:29.831 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:29,830 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:35:29.831 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:29,830 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:35:29.832 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:29,830 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:35:29.832 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:29,830 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:35:29.832 INFO:teuthology.orchestra.run.trial046.stderr:DEBUG 2026-02-20 11:35:29,830 [shard 0:main] seastar - reactor::drain 2026-02-20T11:35:31.875 INFO:teuthology.orchestra.run.trial046.stderr:----------------------------------------------------- 2026-02-20T11:35:31.875 INFO:teuthology.orchestra.run.trial046.stderr:Suppressions used: 2026-02-20T11:35:31.875 INFO:teuthology.orchestra.run.trial046.stderr: count bytes template 2026-02-20T11:35:31.875 INFO:teuthology.orchestra.run.trial046.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:31.875 INFO:teuthology.orchestra.run.trial046.stderr:----------------------------------------------------- 2026-02-20T11:35:31.875 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-20T11:35:31.895 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:35:31.895 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:35:31.940 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:35:31.940 INFO:teuthology.orchestra.run.trial046.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:35:31.947 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:31,946 seastar - Reactor backend: linux-aio 2026-02-20T11:35:31.959 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:31,958 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:31.959 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:31,958 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:31.963 INFO:teuthology.orchestra.run.trial046.stderr:==39180==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:31.964 INFO:teuthology.orchestra.run.trial046.stderr:INFO 2026-02-20 11:35:31,963 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:35:32.024 INFO:teuthology.orchestra.run.trial046.stderr:DEBUG 2026-02-20 11:35:32,024 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:35:32.106 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e2cae3 0x9efa76f 0x9efa937 0x9efaa98 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.106 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x10a35bf 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.106 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x191c1b /lib64/libasan.so.8+0xc748 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9cf0b5b 0x9d70916 0x9d70a2c 0x9d70b08 0x9d711c4 0x9d70e3d 0x9d7132b 0x9d7172f 0x9d719ec 0x9f1a6cd 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.107 INFO:teuthology.orchestra.run.trial046.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff82b0bada 0xffffffff827d0d37 0xffffffff824910a4 0xffffffff8314d451 0xffffffff83200ba2 2026-02-20T11:35:32.139 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9ea6688 0x9f1d71b 0x9f1d868 0x9f1d8fb 0x9f1e740 0x78bcf19 0x7f65c8f 0x7fb45b4 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:32.181 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15eaf 0x9ca7966 0x9d7cfd6 0x9d7e33d 0x9d93d1b 0x9d949f2 0x9d9199d 0x783a75a 0x78e5228 0x78ea3aa 0x95fdc26 0x9643312 0x7fb16bf 0x7fb1c5d 0x7fb1fb5 0x7fb25de 0x7fb4951 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.182 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xcce4b8 0x9db9f2c 0x9efaf32 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7f67185 0x7fb45b4 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.182 INFO:teuthology.orchestra.run.trial046.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff82b27ef7 0xffffffff827f7f16 0xffffffff827fb8d0 0xffffffff827fcc31 0xffffffff82824893 0xffffffff82824a55 0xffffffff827c97c8 0xffffffff827d3aeb 0xffffffff827d3f4b 0xffffffff824910d2 0xffffffff8314d451 0xffffffff83200ba2 2026-02-20T11:35:32.182 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151c1 0x359d229 0x9e30705 0x9e3080d 0x9ef7d44 0x9ef7ed9 0x9ef826b 0x9ef9851 0x9efab6c 0x9efaf8c 0x9f19778 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7f67185 0x7fb45b4 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.204 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d78fd 0x7d69b08 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:32.214 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.248 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfcaef /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.248 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15277 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.371 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e1eb46 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.372 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0f /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x16507 0x9f08263 0x9f08bc2 0x9f08f45 0x9f1909c 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.372 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b364 /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.454 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:32.469 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.470 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d7d7b 0x7d69b1d 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.470 INFO:teuthology.orchestra.run.trial046.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d89b8 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:34.731 INFO:teuthology.orchestra.run.trial046.stderr:----------------------------------------------------- 2026-02-20T11:35:34.732 INFO:teuthology.orchestra.run.trial046.stderr:Suppressions used: 2026-02-20T11:35:34.732 INFO:teuthology.orchestra.run.trial046.stderr: count bytes template 2026-02-20T11:35:34.732 INFO:teuthology.orchestra.run.trial046.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:34.732 INFO:teuthology.orchestra.run.trial046.stderr:----------------------------------------------------- 2026-02-20T11:35:34.732 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-20T11:35:34.767 DEBUG:teuthology.orchestra.run.trial046:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T11:35:34.792 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T11:35:34.818 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:34.818 INFO:tasks.ceph:role: osd.2 2026-02-20T11:35:34.818 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial086.front.sepia.ceph.com 2026-02-20T11:35:34.818 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:35:34.883 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:35:34.884 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:35:34.884 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:35:34.884 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:35:34.884 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:35:34.884 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:35:34.884 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:35:34.884 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:35:34.884 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:35:34.884 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:35:35.452 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-20T11:35:35.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-20T11:35:35.455 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-20T11:35:35.524 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T11:35:35.592 DEBUG:teuthology.orchestra.run.trial086:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-20T11:35:35.656 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:35.656 INFO:tasks.ceph:role: osd.3 2026-02-20T11:35:35.656 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial086.front.sepia.ceph.com 2026-02-20T11:35:35.656 DEBUG:teuthology.orchestra.run.trial086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:35:35.720 INFO:teuthology.orchestra.run.trial086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:35:36.278 INFO:teuthology.orchestra.run.trial086.stdout:Discarding blocks...Done. 2026-02-20T11:35:36.280 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial086.front.sepia.ceph.com -o noatime 2026-02-20T11:35:36.280 DEBUG:teuthology.orchestra.run.trial086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-20T11:35:36.350 DEBUG:teuthology.orchestra.run.trial086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-20T11:35:36.419 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:36.570 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:35:36.632 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:36,630 seastar - Reactor backend: linux-aio 2026-02-20T11:35:36.643 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:36,642 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:36.643 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:36,642 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:36.645 INFO:teuthology.orchestra.run.trial086.stderr:==38934==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:36.702 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:36,700 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:35:36.703 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:36,700 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:35:36.703 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:36,700 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:35:36.703 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:36,700 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:35:36.703 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-20 11:35:36,701 [shard 0:main] seastar - reactor::drain 2026-02-20T11:35:38.773 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-20T11:35:38.773 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-20T11:35:38.773 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-20T11:35:38.773 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:38.773 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-20T11:35:38.774 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-20T11:35:38.794 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:35:38.794 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:35:38.835 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:35:38.835 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:35:38.842 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:38,840 seastar - Reactor backend: linux-aio 2026-02-20T11:35:38.855 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:38,853 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:38.855 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:38,853 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:38.858 INFO:teuthology.orchestra.run.trial086.stderr:==38932==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:38.859 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:38,857 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:35:38.916 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-20 11:35:38,915 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:35:38.997 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65d9 /lib64/libasan.so.8+0x157c7 0x9ef7da6 0x9ef7ed9 0x9ef826b 0x9ef9851 0x9efab6c 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:38.997 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libstdc++.so.6+0xc6247 0x31f9a39 0x9e1e6ff 0x9e1ea02 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:38.997 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9ee0ab7 0x9ee0c37 0x9ee0ea7 0x9ee0fac 0x9f137b3 0x9f13f56 0x9f1e423 0x78bcf19 0x7b9c081 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.029 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x7f6bf94 0x7f6c5ce 0x7f6c6fa 0x7f6f26f 0x7f6fec3 0x7f70184 0x7e5a8a9 0x7fb3f68 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:39.073 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x3549bce 0x3549be4 0x359d2e4 0x9e30705 0x9e307c7 0x9ef7d44 0x9ef7ed9 0x9ef826b 0x9ef9851 0x9efab6c 0x9efaf8c 0x9f19778 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7f67185 0x7fb45b4 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.096 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c2 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:39.138 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfcaef /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.138 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6583 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.139 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.259 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1521a 0x1138fc8 0xf4864f 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e1fa02 0x9e27a85 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.259 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b364 /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.259 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xe8ed /lib64/libasan.so.8+0xef905 0xbc9310 0xbc938a 0xbc94a3 0x9efafad 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.341 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d79b2 0x7d69b08 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:39.357 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.357 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:39.357 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129747 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:41.471 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-20T11:35:41.472 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-20T11:35:41.472 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-20T11:35:41.472 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:41.472 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-20T11:35:41.472 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-20T11:35:41.507 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T11:35:41.532 DEBUG:teuthology.orchestra.run.trial086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:41.686 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:35:41.739 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:41,738 seastar - Reactor backend: linux-aio 2026-02-20T11:35:41.757 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:41,756 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:41.758 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:41,756 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:41.760 INFO:teuthology.orchestra.run.trial086.stderr:==39003==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:41.816 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:41,814 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:35:41.816 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:41,814 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:35:41.816 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:41,814 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:35:41.816 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:41,814 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:35:41.817 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-20 11:35:41,814 [shard 0:main] seastar - reactor::drain 2026-02-20T11:35:43.882 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-20T11:35:43.882 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-20T11:35:43.882 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-20T11:35:43.882 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:43.883 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-20T11:35:43.883 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-20T11:35:43.903 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:35:43.903 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:35:43.947 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:35:43.947 INFO:teuthology.orchestra.run.trial086.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:35:43.954 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:43,952 seastar - Reactor backend: linux-aio 2026-02-20T11:35:43.970 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:43,968 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:43.970 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:43,968 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:43.973 INFO:teuthology.orchestra.run.trial086.stderr:==39001==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:43.973 INFO:teuthology.orchestra.run.trial086.stderr:INFO 2026-02-20 11:35:43,972 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:35:44.032 INFO:teuthology.orchestra.run.trial086.stderr:DEBUG 2026-02-20 11:35:44,031 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:35:44.113 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15835 0x10a3723 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.113 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x77e9899 0x9cf0836 0x9f1b9a3 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.113 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfd1ad /lib64/libasan.so.8+0xedcb5 0xe419a1 0x78bce3c 0x7b9c686 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.145 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x157b4 0xdc1d68 0x34d9ade 0x34d9faa 0x350c8c1 0x350cabd 0x33d2452 0x33d3316 0xd14917 0xd14bca 0xe61245 0x90ebca5 0x90ec1c0 0x91669ba 0x7a42cf7 0x718b8df 0x6f76cf2 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:44.188 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x10a3604 0xf4865a 0x9e22cec 0x9e2362b 0x9f16b01 0x9f195df 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7f67185 0x7fb45b4 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.188 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9ed8d22 0x9ee128c 0x9ee158d 0x9ee174f 0x9ee19bf 0x9ee1ac4 0x9f16577 0x9f16d1a 0x9f191e3 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7f67185 0x7fb45b4 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.188 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xc3fe5a 0xc405f3 0x3f8ccdd 0x3f8cf9c 0xb6530b 0xbace1b 0xc86d37 0xc86fcc 0xc8d3ef 0xc8d92e 0xa7b410a 0xc7ecae 0xa81a9ae 0xa81ae2e 0xa81b5aa 0x10edb13 0x7fb4713 0x911dcdf 0x912064d 0x7862725 0x7a52d48 0x6f770d1 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.212 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:44.254 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d7b24 0x29de8d5 0x7d69968 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.254 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.254 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x7d69af7 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.381 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfd153 /lib64/libasan.so.8+0xee7a9 0x9cf0b5b 0x9d70916 0x9d70a2c 0x9d70b08 0x9d711c4 0x9d70e3d 0x9d7132b 0x9d7172f 0x9d719ec 0x9f1a6cd 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.382 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c6 /lib64/libasan.so.8+0x15197 0x359d229 0x9e30705 0x9e307e8 0x9ef7d44 0x9ef7ed9 0x9ef826b 0x9ef9851 0x9efab6c 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.382 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15e50 0x9e1e650 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.431 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x12985d /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa145278 0x9dc2113 0x9dc294e 0xefe35b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb58eb4 2026-02-20T11:35:44.448 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1294d2 /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.480 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c2 /lib64/libasan.so.8+0x15197 0x29d8a29 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:44.481 INFO:teuthology.orchestra.run.trial086.stderr:Reactor stalled for 65 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x29d89d9 0x7d69aef 0x7e5b15a 0x7e5b9c1 0x7e59663 0x78572bb 0x792ffbe 0x794043b 0x794059a 0x7973fa7 0x797959c 0x7979812 0x7979a12 0x7979a8d 0x7979b08 0x7979d54 0x7acf39f 0x7965b04 0x7aa3401 0x73acf1e 0x73b7ed5 0x747550c 0x760f6dc 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:46.659 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-20T11:35:46.659 INFO:teuthology.orchestra.run.trial086.stderr:Suppressions used: 2026-02-20T11:35:46.659 INFO:teuthology.orchestra.run.trial086.stderr: count bytes template 2026-02-20T11:35:46.659 INFO:teuthology.orchestra.run.trial086.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:46.659 INFO:teuthology.orchestra.run.trial086.stderr:----------------------------------------------------- 2026-02-20T11:35:46.659 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-20T11:35:46.694 DEBUG:teuthology.orchestra.run.trial086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-20T11:35:46.718 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T11:35:46.718 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:46.718 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T11:35:46.752 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:46.752 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T11:35:46.827 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:35:46.828 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T11:35:46.853 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:35:46.853 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T11:35:46.918 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:35:46.919 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-20T11:35:46.982 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:46.982 DEBUG:teuthology.orchestra.run.trial046:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T11:35:46.999 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:35:46.999 DEBUG:teuthology.orchestra.run.trial086:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-20T11:35:47.037 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T11:35:47.037 DEBUG:teuthology.orchestra.run.trial046:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T11:35:47.061 INFO:teuthology.orchestra.run.trial046.stdout:[osd.0] 2026-02-20T11:35:47.061 INFO:teuthology.orchestra.run.trial046.stdout: key = AQD+RphpMGY8NBAAj6Jr1eYmvIQH77RqiiEFOw== 2026-02-20T11:35:47.061 INFO:teuthology.orchestra.run.trial046.stdout:[osd.1] 2026-02-20T11:35:47.061 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAER5hpCKypARAAATYQCkWh0WMK0JBvY7Qy/A== 2026-02-20T11:35:47.061 INFO:teuthology.orchestra.run.trial046.stdout:[mgr.x] 2026-02-20T11:35:47.061 INFO:teuthology.orchestra.run.trial046.stdout: key = AQD6RphpHaK9JBAAqm/dlsh61+djCLYrlAiP6A== 2026-02-20T11:35:47.061 INFO:teuthology.orchestra.run.trial046.stdout:[osd.2] 2026-02-20T11:35:47.062 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAKR5hpilTHNhAAJbbbS5Fr60kof2TM6xSnhw== 2026-02-20T11:35:47.062 INFO:teuthology.orchestra.run.trial046.stdout:[osd.3] 2026-02-20T11:35:47.062 INFO:teuthology.orchestra.run.trial046.stdout: key = AQAQR5hpc1QUAhAAIz5Z8QIbY+osZXryyIhtHQ== 2026-02-20T11:35:47.062 INFO:teuthology.orchestra.run.trial046.stdout:[client.0] 2026-02-20T11:35:47.062 INFO:teuthology.orchestra.run.trial046.stdout: key = AQD6Rphp7FCAJxAAscEjg6lyy5legARFbgr39A== 2026-02-20T11:35:47.062 INFO:teuthology.orchestra.run.trial046.stdout:[client.1] 2026-02-20T11:35:47.062 INFO:teuthology.orchestra.run.trial046.stdout: key = AQD6RphpMse6KhAAidRiY7TwM/wISUdnsxzMCg== 2026-02-20T11:35:47.062 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:35:47.150 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:35:47.198 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T11:35:47.245 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:35:47.293 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:35:47.341 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:35:47.391 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:35:47.442 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T11:35:47.442 DEBUG:teuthology.orchestra.run.trial046:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T11:35:47.467 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T11:35:47.553 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:47.551+0000 7fddd249dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.553 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:47.551+0000 7fddd249dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.565 DEBUG:teuthology.orchestra.run.trial046:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T11:35:47.590 DEBUG:teuthology.orchestra.run.trial046:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:47.646 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T11:35:47.647 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T11:35:47.647 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T11:35:47.689 INFO:tasks.ceph.mon.a:Started 2026-02-20T11:35:47.689 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T11:35:47.689 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T11:35:47.689 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T11:35:47.692 INFO:tasks.ceph.mgr.x:Started 2026-02-20T11:35:47.692 DEBUG:tasks.ceph:set 0 configs 2026-02-20T11:35:47.693 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph config dump 2026-02-20T11:35:47.749 INFO:tasks.ceph.mon.a.trial046.stderr:2026-02-20T11:35:47.748+0000 7f3521921c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.749 INFO:tasks.ceph.mon.a.trial046.stderr:2026-02-20T11:35:47.748+0000 7f3521921c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.749 INFO:tasks.ceph.mon.a.trial046.stderr:2026-02-20T11:35:47.748+0000 7f3521921c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.753 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-20T11:35:47.750+0000 7f0ab11d6fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.764 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:47.761+0000 7f70a7bb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.769 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:47.768+0000 7f70a7bb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.777 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-20T11:35:47.775+0000 7f0ab11d6fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.778 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-20T11:35:47.775+0000 7f0ab11d6fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.801 INFO:teuthology.orchestra.run.trial046.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T11:35:47.809 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T11:35:47.810 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T11:35:47.886 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:47.881+0000 7f17abb9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.888 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:47.887+0000 7f17abb9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:47.922 INFO:teuthology.orchestra.run.trial046.stderr:adjusted tunables profile to default 2026-02-20T11:35:47.931 INFO:tasks.ceph:check_enable_crimson: True 2026-02-20T11:35:47.931 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-20T11:35:47.932 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-20T11:35:48.005 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:48.001+0000 7fd9f070b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:48.008 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:48.006+0000 7fd9f070b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:48.047 INFO:tasks.ceph.mon.a.trial046.stderr:2026-02-20T11:35:48.045+0000 7f3519bf1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-20T11:35:48.047 INFO:tasks.ceph.mon.a.trial046.stderr:Please be aware that this feature is experimental, untested, 2026-02-20T11:35:48.047 INFO:tasks.ceph.mon.a.trial046.stderr:unsupported, and may result in data corruption, data loss, 2026-02-20T11:35:48.047 INFO:tasks.ceph.mon.a.trial046.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-20T11:35:48.047 INFO:tasks.ceph.mon.a.trial046.stderr:feature with important data. 2026-02-20T11:35:48.047 INFO:tasks.ceph.mon.a.trial046.stderr: 2026-02-20T11:35:48.614 INFO:tasks.ceph.mgr.x.trial086.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T11:35:48.614 INFO:tasks.ceph.mgr.x.trial086.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T11:35:48.614 INFO:tasks.ceph.mgr.x.trial086.stderr: from numpy import show_config as show_numpy_config 2026-02-20T11:35:48.934 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T11:35:48.935 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:48.935 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T11:35:48.960 DEBUG:teuthology.orchestra.run.trial046:> set -ex 2026-02-20T11:35:48.960 DEBUG:teuthology.orchestra.run.trial046:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T11:35:49.025 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:35:49.025 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T11:35:49.049 DEBUG:teuthology.orchestra.run.trial086:> set -ex 2026-02-20T11:35:49.049 DEBUG:teuthology.orchestra.run.trial086:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-20T11:35:49.113 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd new df10b319-9f41-45f6-a144-e1ecf53b9061 0 2026-02-20T11:35:49.226 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-20T11:35:49.220+0000 7f474ab0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.228 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-20T11:35:49.226+0000 7f474ab0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.267 INFO:teuthology.orchestra.run.trial086.stdout:0 2026-02-20T11:35:49.275 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd new 20e2c7dc-ae1d-411e-9d9d-e11725bb98dd 1 2026-02-20T11:35:49.349 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-20T11:35:49.343+0000 7f18fea3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.351 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-20T11:35:49.348+0000 7f18fea3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.390 INFO:teuthology.orchestra.run.trial086.stdout:1 2026-02-20T11:35:49.400 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd new 5838709d-a85c-4667-adbb-eb8fea1ebba5 2 2026-02-20T11:35:49.474 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-20T11:35:49.468+0000 7f216b88b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.476 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-20T11:35:49.474+0000 7f216b88b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.514 INFO:teuthology.orchestra.run.trial086.stdout:2 2026-02-20T11:35:49.522 DEBUG:teuthology.orchestra.run.trial086:> sudo ceph --cluster ceph osd new 4f1a156e-1da0-4d3e-971f-942bcec74a52 3 2026-02-20T11:35:49.595 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-20T11:35:49.589+0000 7f40d71d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.597 INFO:teuthology.orchestra.run.trial086.stderr:2026-02-20T11:35:49.594+0000 7f40d71d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.636 INFO:teuthology.orchestra.run.trial086.stdout:3 2026-02-20T11:35:49.644 DEBUG:teuthology.orchestra.run.trial046:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-20T11:35:49.672 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T11:35:49.673 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T11:35:49.715 INFO:tasks.ceph.osd.0:Started 2026-02-20T11:35:49.715 DEBUG:teuthology.orchestra.run.trial046:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-20T11:35:49.745 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T11:35:49.745 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T11:35:49.787 INFO:tasks.ceph.osd.1:Started 2026-02-20T11:35:49.788 DEBUG:teuthology.orchestra.run.trial086:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-20T11:35:49.815 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T11:35:49.816 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T11:35:49.859 INFO:tasks.ceph.osd.2:Started 2026-02-20T11:35:49.859 DEBUG:teuthology.orchestra.run.trial086:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-20T11:35:49.887 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T11:35:49.887 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-20T11:35:49.929 INFO:tasks.ceph.osd.3:Started 2026-02-20T11:35:49.930 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:35:50.007 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:50.002+0000 7fdbd56cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:50.009 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:50.007+0000 7fdbd56cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:50.044 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:35:50.044 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":7,"fsid":"6a7e41b7-6f36-42a8-877b-32f239584843","created":"2026-02-20T11:35:47.761524+0000","modified":"2026-02-20T11:35:49.635256+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:35:49.635256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"df10b319-9f41-45f6-a144-e1ecf53b9061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"20e2c7dc-ae1d-411e-9d9d-e11725bb98dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5838709d-a85c-4667-adbb-eb8fea1ebba5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4f1a156e-1da0-4d3e-971f-942bcec74a52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:35:50.053 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T11:35:50.053 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T11:35:50.457 DEBUG:teuthology.orchestra.run.trial046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:35:50.524 INFO:teuthology.misc.health.trial046.stderr:2026-02-20T11:35:50.519+0000 7fe07621a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:50.526 INFO:teuthology.misc.health.trial046.stderr:2026-02-20T11:35:50.524+0000 7fe07621a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:50.558 INFO:teuthology.misc.health.trial046.stdout: 2026-02-20T11:35:50.559 INFO:teuthology.misc.health.trial046.stdout:{"epoch":7,"fsid":"6a7e41b7-6f36-42a8-877b-32f239584843","created":"2026-02-20T11:35:47.761524+0000","modified":"2026-02-20T11:35:49.635256+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:35:49.635256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"df10b319-9f41-45f6-a144-e1ecf53b9061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"20e2c7dc-ae1d-411e-9d9d-e11725bb98dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5838709d-a85c-4667-adbb-eb8fea1ebba5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4f1a156e-1da0-4d3e-971f-942bcec74a52","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:35:50.566 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-20T11:35:50.976 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-20T11:35:50.974+0000 7f09cc25e640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T11:35:56.969 DEBUG:teuthology.orchestra.run.trial046:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:35:57.040 INFO:teuthology.misc.health.trial046.stderr:2026-02-20T11:35:57.036+0000 7f1d3570b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.042 INFO:teuthology.misc.health.trial046.stderr:2026-02-20T11:35:57.040+0000 7f1d3570b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.153 INFO:teuthology.misc.health.trial046.stdout: 2026-02-20T11:35:57.153 INFO:teuthology.misc.health.trial046.stdout:{"epoch":11,"fsid":"6a7e41b7-6f36-42a8-877b-32f239584843","created":"2026-02-20T11:35:47.761524+0000","modified":"2026-02-20T11:35:56.990729+0000","last_up_change":"2026-02-20T11:35:56.990729+0000","last_in_change":"2026-02-20T11:35:49.635256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"df10b319-9f41-45f6-a144-e1ecf53b9061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6805","nonce":1579574589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6804","nonce":1579574589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6800","nonce":1579574589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6803","nonce":1579574589}]},"public_addr":"10.20.193.46:6805/1579574589","cluster_addr":"10.20.193.46:6804/1579574589","heartbeat_back_addr":"10.20.193.46:6800/1579574589","heartbeat_front_addr":"10.20.193.46:6803/1579574589","state":["exists","up"]},{"osd":1,"uuid":"20e2c7dc-ae1d-411e-9d9d-e11725bb98dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6812","nonce":3345070759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6811","nonce":3345070759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6802","nonce":3345070759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6801","nonce":3345070759}]},"public_addr":"10.20.193.46:6812/3345070759","cluster_addr":"10.20.193.46:6811/3345070759","heartbeat_back_addr":"10.20.193.46:6802/3345070759","heartbeat_front_addr":"10.20.193.46:6801/3345070759","state":["exists","up"]},{"osd":2,"uuid":"5838709d-a85c-4667-adbb-eb8fea1ebba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":627920343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6811","nonce":627920343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6803","nonce":627920343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":627920343}]},"public_addr":"10.20.193.86:6810/627920343","cluster_addr":"10.20.193.86:6811/627920343","heartbeat_back_addr":"10.20.193.86:6803/627920343","heartbeat_front_addr":"10.20.193.86:6802/627920343","state":["exists","up"]},{"osd":3,"uuid":"4f1a156e-1da0-4d3e-971f-942bcec74a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":3678964949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6807","nonce":3678964949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":3678964949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6805","nonce":3678964949}]},"public_addr":"10.20.193.86:6806/3678964949","cluster_addr":"10.20.193.86:6807/3678964949","heartbeat_back_addr":"10.20.193.86:6804/3678964949","heartbeat_front_addr":"10.20.193.86:6805/3678964949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:35:57.161 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-20T11:35:57.161 INFO:tasks.ceph:Creating RBD pool 2026-02-20T11:35:57.161 DEBUG:teuthology.orchestra.run.trial046:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T11:35:57.236 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:57.230+0000 7fcaf13a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.238 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:57.236+0000 7fcaf13a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:58.001 INFO:teuthology.orchestra.run.trial046.stderr:pool 'rbd' created 2026-02-20T11:35:58.013 DEBUG:teuthology.orchestra.run.trial046:> rbd --cluster ceph pool init rbd 2026-02-20T11:35:58.061 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:58.058+0000 7fb3ebcdf240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:58.061 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:58.058+0000 7fb3ebcdf240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:58.064 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:35:58.062+0000 7fb3ebcdf240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:01.037 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T11:36:01.037 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T11:36:01.038 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T11:36:01.154 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.149+0000 7f49ac1a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:01.156 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.154+0000 7f49ac1a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:01.270 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:01.279 INFO:teuthology.orchestra.run.trial046.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-20T11:36:01.280 INFO:tasks.ceph_manager:config epoch is 1 2026-02-20T11:36:01.280 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T11:36:01.280 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T11:36:01.280 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T11:36:01.355 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.350+0000 7f7cc7a35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:01.358 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.355+0000 7f7cc7a35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:01.502 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:01.511 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6800","nonce":1212125066},{"type":"v1","addr":"10.20.193.86:6801","nonce":1212125066}]},"active_addr":"10.20.193.86:6801/1212125066","active_change":"2026-02-20T11:35:49.970347+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.86:0","nonce":2518908199}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.86:0","nonce":2125259237}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.86:0","nonce":1094346406}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.86:0","nonce":921781906}]}]} 2026-02-20T11:36:01.515 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T11:36:01.515 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T11:36:01.515 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:36:01.593 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.589+0000 7efec4b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:01.596 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.593+0000 7efec4b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:01.707 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:01.708 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":15,"fsid":"6a7e41b7-6f36-42a8-877b-32f239584843","created":"2026-02-20T11:35:47.761524+0000","modified":"2026-02-20T11:36:01.008904+0000","last_up_change":"2026-02-20T11:35:56.990729+0000","last_in_change":"2026-02-20T11:35:49.635256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T11:35:57.354096+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-20T11:35:57.989770+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df10b319-9f41-45f6-a144-e1ecf53b9061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6805","nonce":1579574589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6804","nonce":1579574589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6800","nonce":1579574589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6803","nonce":1579574589}]},"public_addr":"10.20.193.46:6805/1579574589","cluster_addr":"10.20.193.46:6804/1579574589","heartbeat_back_addr":"10.20.193.46:6800/1579574589","heartbeat_front_addr":"10.20.193.46:6803/1579574589","state":["exists","up"]},{"osd":1,"uuid":"20e2c7dc-ae1d-411e-9d9d-e11725bb98dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6812","nonce":3345070759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6811","nonce":3345070759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6802","nonce":3345070759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6801","nonce":3345070759}]},"public_addr":"10.20.193.46:6812/3345070759","cluster_addr":"10.20.193.46:6811/3345070759","heartbeat_back_addr":"10.20.193.46:6802/3345070759","heartbeat_front_addr":"10.20.193.46:6801/3345070759","state":["exists","up"]},{"osd":2,"uuid":"5838709d-a85c-4667-adbb-eb8fea1ebba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":627920343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6811","nonce":627920343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6803","nonce":627920343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":627920343}]},"public_addr":"10.20.193.86:6810/627920343","cluster_addr":"10.20.193.86:6811/627920343","heartbeat_back_addr":"10.20.193.86:6803/627920343","heartbeat_front_addr":"10.20.193.86:6802/627920343","state":["exists","up"]},{"osd":3,"uuid":"4f1a156e-1da0-4d3e-971f-942bcec74a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":3678964949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6807","nonce":3678964949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":3678964949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6805","nonce":3678964949}]},"public_addr":"10.20.193.86:6806/3678964949","cluster_addr":"10.20.193.86:6807/3678964949","heartbeat_back_addr":"10.20.193.86:6804/3678964949","heartbeat_front_addr":"10.20.193.86:6805/3678964949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:36:01.717 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T11:36:01.717 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:36:01.792 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.787+0000 7f53f7b5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:01.794 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.792+0000 7f53f7b5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:01.908 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:01.909 INFO:teuthology.orchestra.run.trial046.stdout:{"epoch":15,"fsid":"6a7e41b7-6f36-42a8-877b-32f239584843","created":"2026-02-20T11:35:47.761524+0000","modified":"2026-02-20T11:36:01.008904+0000","last_up_change":"2026-02-20T11:35:56.990729+0000","last_in_change":"2026-02-20T11:35:49.635256+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T11:35:57.354096+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-20T11:35:57.989770+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"df10b319-9f41-45f6-a144-e1ecf53b9061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6805","nonce":1579574589}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6804","nonce":1579574589}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6800","nonce":1579574589}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6803","nonce":1579574589}]},"public_addr":"10.20.193.46:6805/1579574589","cluster_addr":"10.20.193.46:6804/1579574589","heartbeat_back_addr":"10.20.193.46:6800/1579574589","heartbeat_front_addr":"10.20.193.46:6803/1579574589","state":["exists","up"]},{"osd":1,"uuid":"20e2c7dc-ae1d-411e-9d9d-e11725bb98dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6812","nonce":3345070759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6811","nonce":3345070759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6802","nonce":3345070759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.46:6801","nonce":3345070759}]},"public_addr":"10.20.193.46:6812/3345070759","cluster_addr":"10.20.193.46:6811/3345070759","heartbeat_back_addr":"10.20.193.46:6802/3345070759","heartbeat_front_addr":"10.20.193.46:6801/3345070759","state":["exists","up"]},{"osd":2,"uuid":"5838709d-a85c-4667-adbb-eb8fea1ebba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6810","nonce":627920343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6811","nonce":627920343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6803","nonce":627920343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6802","nonce":627920343}]},"public_addr":"10.20.193.86:6810/627920343","cluster_addr":"10.20.193.86:6811/627920343","heartbeat_back_addr":"10.20.193.86:6803/627920343","heartbeat_front_addr":"10.20.193.86:6802/627920343","state":["exists","up"]},{"osd":3,"uuid":"4f1a156e-1da0-4d3e-971f-942bcec74a52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6806","nonce":3678964949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6807","nonce":3678964949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6804","nonce":3678964949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.86:6805","nonce":3678964949}]},"public_addr":"10.20.193.86:6806/3678964949","cluster_addr":"10.20.193.86:6807/3678964949","heartbeat_back_addr":"10.20.193.86:6804/3678964949","heartbeat_front_addr":"10.20.193.86:6805/3678964949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:36:01.920 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T11:36:01.920 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T11:36:01.921 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T11:36:01.921 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-20T11:36:02.004 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.999+0000 7f813e3dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.016 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:01.999+0000 7ff054a06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.016 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.000+0000 7f68e645a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.017 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.004+0000 7f813e3dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.017 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.004+0000 7ff054a06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.017 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.001+0000 7fd0895cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.018 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.005+0000 7f68e645a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.018 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.007+0000 7fd0895cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.025 INFO:teuthology.orchestra.run.trial046.stdout:47244640261 2026-02-20T11:36:02.026 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T11:36:02.027 INFO:teuthology.orchestra.run.trial046.stdout:47244640261 2026-02-20T11:36:02.027 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:36:02.029 INFO:teuthology.orchestra.run.trial046.stdout:47244640261 2026-02-20T11:36:02.029 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T11:36:02.030 INFO:teuthology.orchestra.run.trial046.stdout:42949672966 2026-02-20T11:36:02.031 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:36:02.150 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.145+0000 7f7fa3e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.152 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.147+0000 7fc42b7ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.152 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.150+0000 7f7fa3e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.155 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.153+0000 7fc42b7ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.197 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.193+0000 7fe7496cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.197 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.193+0000 7f8c6ad0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.199 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.197+0000 7fe7496cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.200 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.198+0000 7f8c6ad0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.265 INFO:teuthology.orchestra.run.trial046.stdout:47244640261 2026-02-20T11:36:02.271 INFO:teuthology.orchestra.run.trial046.stdout:47244640261 2026-02-20T11:36:02.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.0 2026-02-20T11:36:02.276 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:02.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.2 2026-02-20T11:36:02.282 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:02.312 INFO:teuthology.orchestra.run.trial046.stdout:42949672966 2026-02-20T11:36:02.315 INFO:teuthology.orchestra.run.trial046.stdout:47244640261 2026-02-20T11:36:02.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2026-02-20T11:36:02.322 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:02.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.3 2026-02-20T11:36:02.326 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:02.327 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:36:02.327 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:36:02.441 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.436+0000 7fe38110b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.443 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.441+0000 7fe38110b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.552 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:02.553 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-20T11:36:02.561 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T11:36:02.021093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":4056,"kb_used_data":4056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208662568,"statfs":{"total":213674622976,"available":213670469632,"internally_reserved":0,"allocated":4153344,"data_stored":4153344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021390+0000","last_change":"2026-02-20T11:36:01.025256+0000","last_active":"2026-02-20T11:36:01.021390+0000","last_peered":"2026-02-20T11:36:01.021390+0000","last_clean":"2026-02-20T11:36:01.021390+0000","last_became_active":"2026-02-20T11:35:59.082337+0000","last_became_peered":"2026-02-20T11:35:59.082337+0000","last_unstale":"2026-02-20T11:36:01.021390+0000","last_undegraded":"2026-02-20T11:36:01.021390+0000","last_fullsized":"2026-02-20T11:36:01.021390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021117+0000","last_change":"2026-02-20T11:36:01.025173+0000","last_active":"2026-02-20T11:36:01.021117+0000","last_peered":"2026-02-20T11:36:01.021117+0000","last_clean":"2026-02-20T11:36:01.021117+0000","last_became_active":"2026-02-20T11:35:59.055623+0000","last_became_peered":"2026-02-20T11:35:59.055623+0000","last_unstale":"2026-02-20T11:36:01.021117+0000","last_undegraded":"2026-02-20T11:36:01.021117+0000","last_fullsized":"2026-02-20T11:36:01.021117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021120+0000","last_change":"2026-02-20T11:36:01.023609+0000","last_active":"2026-02-20T11:36:01.021120+0000","last_peered":"2026-02-20T11:36:01.021120+0000","last_clean":"2026-02-20T11:36:01.021120+0000","last_became_active":"2026-02-20T11:35:59.044553+0000","last_became_peered":"2026-02-20T11:35:59.044553+0000","last_unstale":"2026-02-20T11:36:01.021120+0000","last_undegraded":"2026-02-20T11:36:01.021120+0000","last_fullsized":"2026-02-20T11:36:01.021120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019704+0000","last_change":"2026-02-20T11:36:01.022149+0000","last_active":"2026-02-20T11:36:01.019704+0000","last_peered":"2026-02-20T11:36:01.019704+0000","last_clean":"2026-02-20T11:36:01.019704+0000","last_became_active":"2026-02-20T11:35:59.065276+0000","last_became_peered":"2026-02-20T11:35:59.065276+0000","last_unstale":"2026-02-20T11:36:01.019704+0000","last_undegraded":"2026-02-20T11:36:01.019704+0000","last_fullsized":"2026-02-20T11:36:01.019704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019253+0000","last_change":"2026-02-20T11:35:59.060440+0000","last_active":"2026-02-20T11:36:01.019253+0000","last_peered":"2026-02-20T11:36:01.019253+0000","last_clean":"2026-02-20T11:36:01.019253+0000","last_became_active":"2026-02-20T11:35:59.043888+0000","last_became_peered":"2026-02-20T11:35:59.043888+0000","last_unstale":"2026-02-20T11:36:01.019253+0000","last_undegraded":"2026-02-20T11:36:01.019253+0000","last_fullsized":"2026-02-20T11:36:01.019253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.017868+0000","last_change":"2026-02-20T11:36:01.021350+0000","last_active":"2026-02-20T11:36:01.017868+0000","last_peered":"2026-02-20T11:36:01.017868+0000","last_clean":"2026-02-20T11:36:01.017868+0000","last_became_active":"2026-02-20T11:35:59.059484+0000","last_became_peered":"2026-02-20T11:35:59.059484+0000","last_unstale":"2026-02-20T11:36:01.017868+0000","last_undegraded":"2026-02-20T11:36:01.017868+0000","last_fullsized":"2026-02-20T11:36:01.017868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.022784+0000","last_change":"2026-02-20T11:36:01.022784+0000","last_active":"2026-02-20T11:36:01.022784+0000","last_peered":"2026-02-20T11:36:01.022784+0000","last_clean":"2026-02-20T11:36:01.022784+0000","last_became_active":"2026-02-20T11:35:59.048324+0000","last_became_peered":"2026-02-20T11:35:59.048324+0000","last_unstale":"2026-02-20T11:36:01.022784+0000","last_undegraded":"2026-02-20T11:36:01.022784+0000","last_fullsized":"2026-02-20T11:36:01.022784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021084+0000","last_change":"2026-02-20T11:36:01.023332+0000","last_active":"2026-02-20T11:36:01.021084+0000","last_peered":"2026-02-20T11:36:01.021084+0000","last_clean":"2026-02-20T11:36:01.021084+0000","last_became_active":"2026-02-20T11:35:59.046602+0000","last_became_peered":"2026-02-20T11:35:59.046602+0000","last_unstale":"2026-02-20T11:36:01.021084+0000","last_undegraded":"2026-02-20T11:36:01.021084+0000","last_fullsized":"2026-02-20T11:36:01.021084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019792+0000","last_change":"2026-02-20T11:36:01.022683+0000","last_active":"2026-02-20T11:36:01.019792+0000","last_peered":"2026-02-20T11:36:01.019792+0000","last_clean":"2026-02-20T11:36:01.019792+0000","last_became_active":"2026-02-20T11:35:59.079114+0000","last_became_peered":"2026-02-20T11:35:59.079114+0000","last_unstale":"2026-02-20T11:36:01.019792+0000","last_undegraded":"2026-02-20T11:36:01.019792+0000","last_fullsized":"2026-02-20T11:36:01.019792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253014016,"internally_reserved":0,"allocated":2953216,"data_stored":2953216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1268,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165388,"statfs":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":480,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166176,"statfs":{"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1136,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165520,"statfs":{"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165484,"statfs":{"total":53418655744,"available":53417455616,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:36:02.563 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:36:02.640 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.635+0000 7f00147dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.642 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.640+0000 7f00147dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.751 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:02.752 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-20T11:36:02.760 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T11:36:02.021093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":4056,"kb_used_data":4056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208662568,"statfs":{"total":213674622976,"available":213670469632,"internally_reserved":0,"allocated":4153344,"data_stored":4153344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021390+0000","last_change":"2026-02-20T11:36:01.025256+0000","last_active":"2026-02-20T11:36:01.021390+0000","last_peered":"2026-02-20T11:36:01.021390+0000","last_clean":"2026-02-20T11:36:01.021390+0000","last_became_active":"2026-02-20T11:35:59.082337+0000","last_became_peered":"2026-02-20T11:35:59.082337+0000","last_unstale":"2026-02-20T11:36:01.021390+0000","last_undegraded":"2026-02-20T11:36:01.021390+0000","last_fullsized":"2026-02-20T11:36:01.021390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021117+0000","last_change":"2026-02-20T11:36:01.025173+0000","last_active":"2026-02-20T11:36:01.021117+0000","last_peered":"2026-02-20T11:36:01.021117+0000","last_clean":"2026-02-20T11:36:01.021117+0000","last_became_active":"2026-02-20T11:35:59.055623+0000","last_became_peered":"2026-02-20T11:35:59.055623+0000","last_unstale":"2026-02-20T11:36:01.021117+0000","last_undegraded":"2026-02-20T11:36:01.021117+0000","last_fullsized":"2026-02-20T11:36:01.021117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021120+0000","last_change":"2026-02-20T11:36:01.023609+0000","last_active":"2026-02-20T11:36:01.021120+0000","last_peered":"2026-02-20T11:36:01.021120+0000","last_clean":"2026-02-20T11:36:01.021120+0000","last_became_active":"2026-02-20T11:35:59.044553+0000","last_became_peered":"2026-02-20T11:35:59.044553+0000","last_unstale":"2026-02-20T11:36:01.021120+0000","last_undegraded":"2026-02-20T11:36:01.021120+0000","last_fullsized":"2026-02-20T11:36:01.021120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019704+0000","last_change":"2026-02-20T11:36:01.022149+0000","last_active":"2026-02-20T11:36:01.019704+0000","last_peered":"2026-02-20T11:36:01.019704+0000","last_clean":"2026-02-20T11:36:01.019704+0000","last_became_active":"2026-02-20T11:35:59.065276+0000","last_became_peered":"2026-02-20T11:35:59.065276+0000","last_unstale":"2026-02-20T11:36:01.019704+0000","last_undegraded":"2026-02-20T11:36:01.019704+0000","last_fullsized":"2026-02-20T11:36:01.019704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019253+0000","last_change":"2026-02-20T11:35:59.060440+0000","last_active":"2026-02-20T11:36:01.019253+0000","last_peered":"2026-02-20T11:36:01.019253+0000","last_clean":"2026-02-20T11:36:01.019253+0000","last_became_active":"2026-02-20T11:35:59.043888+0000","last_became_peered":"2026-02-20T11:35:59.043888+0000","last_unstale":"2026-02-20T11:36:01.019253+0000","last_undegraded":"2026-02-20T11:36:01.019253+0000","last_fullsized":"2026-02-20T11:36:01.019253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.017868+0000","last_change":"2026-02-20T11:36:01.021350+0000","last_active":"2026-02-20T11:36:01.017868+0000","last_peered":"2026-02-20T11:36:01.017868+0000","last_clean":"2026-02-20T11:36:01.017868+0000","last_became_active":"2026-02-20T11:35:59.059484+0000","last_became_peered":"2026-02-20T11:35:59.059484+0000","last_unstale":"2026-02-20T11:36:01.017868+0000","last_undegraded":"2026-02-20T11:36:01.017868+0000","last_fullsized":"2026-02-20T11:36:01.017868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.022784+0000","last_change":"2026-02-20T11:36:01.022784+0000","last_active":"2026-02-20T11:36:01.022784+0000","last_peered":"2026-02-20T11:36:01.022784+0000","last_clean":"2026-02-20T11:36:01.022784+0000","last_became_active":"2026-02-20T11:35:59.048324+0000","last_became_peered":"2026-02-20T11:35:59.048324+0000","last_unstale":"2026-02-20T11:36:01.022784+0000","last_undegraded":"2026-02-20T11:36:01.022784+0000","last_fullsized":"2026-02-20T11:36:01.022784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021084+0000","last_change":"2026-02-20T11:36:01.023332+0000","last_active":"2026-02-20T11:36:01.021084+0000","last_peered":"2026-02-20T11:36:01.021084+0000","last_clean":"2026-02-20T11:36:01.021084+0000","last_became_active":"2026-02-20T11:35:59.046602+0000","last_became_peered":"2026-02-20T11:35:59.046602+0000","last_unstale":"2026-02-20T11:36:01.021084+0000","last_undegraded":"2026-02-20T11:36:01.021084+0000","last_fullsized":"2026-02-20T11:36:01.021084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019792+0000","last_change":"2026-02-20T11:36:01.022683+0000","last_active":"2026-02-20T11:36:01.019792+0000","last_peered":"2026-02-20T11:36:01.019792+0000","last_clean":"2026-02-20T11:36:01.019792+0000","last_became_active":"2026-02-20T11:35:59.079114+0000","last_became_peered":"2026-02-20T11:35:59.079114+0000","last_unstale":"2026-02-20T11:36:01.019792+0000","last_undegraded":"2026-02-20T11:36:01.019792+0000","last_fullsized":"2026-02-20T11:36:01.019792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253014016,"internally_reserved":0,"allocated":2953216,"data_stored":2953216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1268,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165388,"statfs":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":480,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166176,"statfs":{"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1136,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165520,"statfs":{"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165484,"statfs":{"total":53418655744,"available":53417455616,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:36:02.761 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:36:02.762 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T11:36:02.762 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T11:36:02.762 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T11:36:02.838 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.834+0000 7fc7f8235640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.840 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:02.838+0000 7fc7f8235640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:02.977 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:02.978 INFO:teuthology.orchestra.run.trial046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T11:36:02.987 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T11:36:02.987 INFO:teuthology.run_tasks:Running task thrashosds... 2026-02-20T11:36:03.005 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T11:36:03.005 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}} 2026-02-20T11:36:03.005 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T11:36:03.005 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2026-02-20T11:36:03.086 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:03.079+0000 7fd524bb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:03.088 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:03.086+0000 7fd524bb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:03.209 INFO:tasks.thrashosds:Beginning thrashosds... 2026-02-20T11:36:03.210 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:36:03.210 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:36:03.285 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:03.280+0000 7ff5580b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:03.287 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:03.285+0000 7ff5580b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:03.397 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:03.398 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-20T11:36:03.407 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T11:36:02.021093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":4056,"kb_used_data":4056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208662568,"statfs":{"total":213674622976,"available":213670469632,"internally_reserved":0,"allocated":4153344,"data_stored":4153344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021390+0000","last_change":"2026-02-20T11:36:01.025256+0000","last_active":"2026-02-20T11:36:01.021390+0000","last_peered":"2026-02-20T11:36:01.021390+0000","last_clean":"2026-02-20T11:36:01.021390+0000","last_became_active":"2026-02-20T11:35:59.082337+0000","last_became_peered":"2026-02-20T11:35:59.082337+0000","last_unstale":"2026-02-20T11:36:01.021390+0000","last_undegraded":"2026-02-20T11:36:01.021390+0000","last_fullsized":"2026-02-20T11:36:01.021390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021117+0000","last_change":"2026-02-20T11:36:01.025173+0000","last_active":"2026-02-20T11:36:01.021117+0000","last_peered":"2026-02-20T11:36:01.021117+0000","last_clean":"2026-02-20T11:36:01.021117+0000","last_became_active":"2026-02-20T11:35:59.055623+0000","last_became_peered":"2026-02-20T11:35:59.055623+0000","last_unstale":"2026-02-20T11:36:01.021117+0000","last_undegraded":"2026-02-20T11:36:01.021117+0000","last_fullsized":"2026-02-20T11:36:01.021117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021120+0000","last_change":"2026-02-20T11:36:01.023609+0000","last_active":"2026-02-20T11:36:01.021120+0000","last_peered":"2026-02-20T11:36:01.021120+0000","last_clean":"2026-02-20T11:36:01.021120+0000","last_became_active":"2026-02-20T11:35:59.044553+0000","last_became_peered":"2026-02-20T11:35:59.044553+0000","last_unstale":"2026-02-20T11:36:01.021120+0000","last_undegraded":"2026-02-20T11:36:01.021120+0000","last_fullsized":"2026-02-20T11:36:01.021120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019704+0000","last_change":"2026-02-20T11:36:01.022149+0000","last_active":"2026-02-20T11:36:01.019704+0000","last_peered":"2026-02-20T11:36:01.019704+0000","last_clean":"2026-02-20T11:36:01.019704+0000","last_became_active":"2026-02-20T11:35:59.065276+0000","last_became_peered":"2026-02-20T11:35:59.065276+0000","last_unstale":"2026-02-20T11:36:01.019704+0000","last_undegraded":"2026-02-20T11:36:01.019704+0000","last_fullsized":"2026-02-20T11:36:01.019704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019253+0000","last_change":"2026-02-20T11:35:59.060440+0000","last_active":"2026-02-20T11:36:01.019253+0000","last_peered":"2026-02-20T11:36:01.019253+0000","last_clean":"2026-02-20T11:36:01.019253+0000","last_became_active":"2026-02-20T11:35:59.043888+0000","last_became_peered":"2026-02-20T11:35:59.043888+0000","last_unstale":"2026-02-20T11:36:01.019253+0000","last_undegraded":"2026-02-20T11:36:01.019253+0000","last_fullsized":"2026-02-20T11:36:01.019253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.017868+0000","last_change":"2026-02-20T11:36:01.021350+0000","last_active":"2026-02-20T11:36:01.017868+0000","last_peered":"2026-02-20T11:36:01.017868+0000","last_clean":"2026-02-20T11:36:01.017868+0000","last_became_active":"2026-02-20T11:35:59.059484+0000","last_became_peered":"2026-02-20T11:35:59.059484+0000","last_unstale":"2026-02-20T11:36:01.017868+0000","last_undegraded":"2026-02-20T11:36:01.017868+0000","last_fullsized":"2026-02-20T11:36:01.017868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.022784+0000","last_change":"2026-02-20T11:36:01.022784+0000","last_active":"2026-02-20T11:36:01.022784+0000","last_peered":"2026-02-20T11:36:01.022784+0000","last_clean":"2026-02-20T11:36:01.022784+0000","last_became_active":"2026-02-20T11:35:59.048324+0000","last_became_peered":"2026-02-20T11:35:59.048324+0000","last_unstale":"2026-02-20T11:36:01.022784+0000","last_undegraded":"2026-02-20T11:36:01.022784+0000","last_fullsized":"2026-02-20T11:36:01.022784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021084+0000","last_change":"2026-02-20T11:36:01.023332+0000","last_active":"2026-02-20T11:36:01.021084+0000","last_peered":"2026-02-20T11:36:01.021084+0000","last_clean":"2026-02-20T11:36:01.021084+0000","last_became_active":"2026-02-20T11:35:59.046602+0000","last_became_peered":"2026-02-20T11:35:59.046602+0000","last_unstale":"2026-02-20T11:36:01.021084+0000","last_undegraded":"2026-02-20T11:36:01.021084+0000","last_fullsized":"2026-02-20T11:36:01.021084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019792+0000","last_change":"2026-02-20T11:36:01.022683+0000","last_active":"2026-02-20T11:36:01.019792+0000","last_peered":"2026-02-20T11:36:01.019792+0000","last_clean":"2026-02-20T11:36:01.019792+0000","last_became_active":"2026-02-20T11:35:59.079114+0000","last_became_peered":"2026-02-20T11:35:59.079114+0000","last_unstale":"2026-02-20T11:36:01.019792+0000","last_undegraded":"2026-02-20T11:36:01.019792+0000","last_fullsized":"2026-02-20T11:36:01.019792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253014016,"internally_reserved":0,"allocated":2953216,"data_stored":2953216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1268,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165388,"statfs":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":480,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166176,"statfs":{"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1136,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165520,"statfs":{"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165484,"statfs":{"total":53418655744,"available":53417455616,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:36:03.409 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:36:03.486 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:03.481+0000 7fc2b645a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:03.488 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:03.486+0000 7fc2b645a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:03.600 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:03.600 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-20T11:36:03.609 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T11:36:02.021093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":4056,"kb_used_data":4056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208662568,"statfs":{"total":213674622976,"available":213670469632,"internally_reserved":0,"allocated":4153344,"data_stored":4153344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021390+0000","last_change":"2026-02-20T11:36:01.025256+0000","last_active":"2026-02-20T11:36:01.021390+0000","last_peered":"2026-02-20T11:36:01.021390+0000","last_clean":"2026-02-20T11:36:01.021390+0000","last_became_active":"2026-02-20T11:35:59.082337+0000","last_became_peered":"2026-02-20T11:35:59.082337+0000","last_unstale":"2026-02-20T11:36:01.021390+0000","last_undegraded":"2026-02-20T11:36:01.021390+0000","last_fullsized":"2026-02-20T11:36:01.021390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021117+0000","last_change":"2026-02-20T11:36:01.025173+0000","last_active":"2026-02-20T11:36:01.021117+0000","last_peered":"2026-02-20T11:36:01.021117+0000","last_clean":"2026-02-20T11:36:01.021117+0000","last_became_active":"2026-02-20T11:35:59.055623+0000","last_became_peered":"2026-02-20T11:35:59.055623+0000","last_unstale":"2026-02-20T11:36:01.021117+0000","last_undegraded":"2026-02-20T11:36:01.021117+0000","last_fullsized":"2026-02-20T11:36:01.021117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021120+0000","last_change":"2026-02-20T11:36:01.023609+0000","last_active":"2026-02-20T11:36:01.021120+0000","last_peered":"2026-02-20T11:36:01.021120+0000","last_clean":"2026-02-20T11:36:01.021120+0000","last_became_active":"2026-02-20T11:35:59.044553+0000","last_became_peered":"2026-02-20T11:35:59.044553+0000","last_unstale":"2026-02-20T11:36:01.021120+0000","last_undegraded":"2026-02-20T11:36:01.021120+0000","last_fullsized":"2026-02-20T11:36:01.021120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019704+0000","last_change":"2026-02-20T11:36:01.022149+0000","last_active":"2026-02-20T11:36:01.019704+0000","last_peered":"2026-02-20T11:36:01.019704+0000","last_clean":"2026-02-20T11:36:01.019704+0000","last_became_active":"2026-02-20T11:35:59.065276+0000","last_became_peered":"2026-02-20T11:35:59.065276+0000","last_unstale":"2026-02-20T11:36:01.019704+0000","last_undegraded":"2026-02-20T11:36:01.019704+0000","last_fullsized":"2026-02-20T11:36:01.019704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019253+0000","last_change":"2026-02-20T11:35:59.060440+0000","last_active":"2026-02-20T11:36:01.019253+0000","last_peered":"2026-02-20T11:36:01.019253+0000","last_clean":"2026-02-20T11:36:01.019253+0000","last_became_active":"2026-02-20T11:35:59.043888+0000","last_became_peered":"2026-02-20T11:35:59.043888+0000","last_unstale":"2026-02-20T11:36:01.019253+0000","last_undegraded":"2026-02-20T11:36:01.019253+0000","last_fullsized":"2026-02-20T11:36:01.019253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.017868+0000","last_change":"2026-02-20T11:36:01.021350+0000","last_active":"2026-02-20T11:36:01.017868+0000","last_peered":"2026-02-20T11:36:01.017868+0000","last_clean":"2026-02-20T11:36:01.017868+0000","last_became_active":"2026-02-20T11:35:59.059484+0000","last_became_peered":"2026-02-20T11:35:59.059484+0000","last_unstale":"2026-02-20T11:36:01.017868+0000","last_undegraded":"2026-02-20T11:36:01.017868+0000","last_fullsized":"2026-02-20T11:36:01.017868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.022784+0000","last_change":"2026-02-20T11:36:01.022784+0000","last_active":"2026-02-20T11:36:01.022784+0000","last_peered":"2026-02-20T11:36:01.022784+0000","last_clean":"2026-02-20T11:36:01.022784+0000","last_became_active":"2026-02-20T11:35:59.048324+0000","last_became_peered":"2026-02-20T11:35:59.048324+0000","last_unstale":"2026-02-20T11:36:01.022784+0000","last_undegraded":"2026-02-20T11:36:01.022784+0000","last_fullsized":"2026-02-20T11:36:01.022784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021084+0000","last_change":"2026-02-20T11:36:01.023332+0000","last_active":"2026-02-20T11:36:01.021084+0000","last_peered":"2026-02-20T11:36:01.021084+0000","last_clean":"2026-02-20T11:36:01.021084+0000","last_became_active":"2026-02-20T11:35:59.046602+0000","last_became_peered":"2026-02-20T11:35:59.046602+0000","last_unstale":"2026-02-20T11:36:01.021084+0000","last_undegraded":"2026-02-20T11:36:01.021084+0000","last_fullsized":"2026-02-20T11:36:01.021084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019792+0000","last_change":"2026-02-20T11:36:01.022683+0000","last_active":"2026-02-20T11:36:01.019792+0000","last_peered":"2026-02-20T11:36:01.019792+0000","last_clean":"2026-02-20T11:36:01.019792+0000","last_became_active":"2026-02-20T11:35:59.079114+0000","last_became_peered":"2026-02-20T11:35:59.079114+0000","last_unstale":"2026-02-20T11:36:01.019792+0000","last_undegraded":"2026-02-20T11:36:01.019792+0000","last_fullsized":"2026-02-20T11:36:01.019792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253014016,"internally_reserved":0,"allocated":2953216,"data_stored":2953216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1268,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165388,"statfs":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":480,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166176,"statfs":{"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1136,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165520,"statfs":{"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165484,"statfs":{"total":53418655744,"available":53417455616,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:36:03.609 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:36:03.609 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-20T11:36:03.686 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:03.681+0000 7f84f67ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:03.689 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:03.686+0000 7f84f67ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:03.799 INFO:teuthology.orchestra.run.trial046.stdout:epoch 15 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:fsid 6a7e41b7-6f36-42a8-877b-32f239584843 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:created 2026-02-20T11:35:47.761524+0000 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:modified 2026-02-20T11:36:01.008904+0000 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:crush_version 5 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:full_ratio 0.95 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:backfillfull_ratio 0.9 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:nearfull_ratio 0.85 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:require_min_compat_client luminous 2026-02-20T11:36:03.800 INFO:teuthology.orchestra.run.trial046.stdout:min_compat_client jewel 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:require_osd_release tentacle 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:stretch_mode_enabled false 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:allow_crimson=true 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.00 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout: removed_snaps_queue [2~1] 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:pool 2 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:max_osd 4 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.46:6805/1579574589 v2:10.20.193.46:6804/1579574589 exists,up df10b319-9f41-45f6-a144-e1ecf53b9061 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:osd.1 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.46:6812/3345070759 v2:10.20.193.46:6811/3345070759 exists,up 20e2c7dc-ae1d-411e-9d9d-e11725bb98dd 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:osd.2 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6810/627920343 v2:10.20.193.86:6811/627920343 exists,up 5838709d-a85c-4667-adbb-eb8fea1ebba5 2026-02-20T11:36:03.801 INFO:teuthology.orchestra.run.trial046.stdout:osd.3 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/3678964949 v2:10.20.193.86:6807/3678964949 exists,up 4f1a156e-1da0-4d3e-971f-942bcec74a52 2026-02-20T11:36:03.809 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.46:6805/1579574589 v2:10.20.193.46:6804/1579574589 exists,up df10b319-9f41-45f6-a144-e1ecf53b9061', 'osd.1 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.46:6812/3345070759 v2:10.20.193.46:6811/3345070759 exists,up 20e2c7dc-ae1d-411e-9d9d-e11725bb98dd', 'osd.2 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6810/627920343 v2:10.20.193.86:6811/627920343 exists,up 5838709d-a85c-4667-adbb-eb8fea1ebba5', 'osd.3 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.86:6806/3678964949 v2:10.20.193.86:6807/3678964949 exists,up 4f1a156e-1da0-4d3e-971f-942bcec74a52'] 2026-02-20T11:36:03.809 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2026-02-20T11:36:03.885 INFO:teuthology.orchestra.run.trial046.stdout:{ 2026-02-20T11:36:03.885 INFO:teuthology.orchestra.run.trial046.stdout: "name": "mon.a", 2026-02-20T11:36:03.885 INFO:teuthology.orchestra.run.trial046.stdout: "cluster": "ceph", 2026-02-20T11:36:03.885 INFO:teuthology.orchestra.run.trial046.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2026-02-20T11:36:03.885 INFO:teuthology.orchestra.run.trial046.stdout: "admin_socket_mode": "", 2026-02-20T11:36:03.885 INFO:teuthology.orchestra.run.trial046.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2026-02-20T11:36:03.885 INFO:teuthology.orchestra.run.trial046.stdout: "auth_client_required": "cephx, none", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "auth_cluster_required": "cephx", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "auth_debug": "true", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "auth_mon_ticket_ttl": "660.000000", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "auth_service_required": "cephx", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "auth_service_ticket_ttl": "240.000000", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "auth_supported": "cephx", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio": "true", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_poll_ms": "250", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_reap_max": "16", 2026-02-20T11:36:03.886 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_async_discard": "false", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_async_discard_threads": "0", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_block_size": "4096", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_aio": "false", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_discard_sleep": "0", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_debug_inflight_ios": "false", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-20T11:36:03.887 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_enable_discard": "false", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_flock_retry": "3", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_inject_crash": "0", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_ioring": "false", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_ioring_hipri": "false", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_max_discard_length": "2147483648", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-20T11:36:03.888 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bdev_type": "", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_alloc_size": "1048576", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_allocator": "hybrid", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_buffered_io": "true", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_check_for_zeros": "false", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_compact_log_sync": "false", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-20T11:36:03.889 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_max_log_runway": "4194304", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_max_prefetch": "1048576", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_min_flush_size": "524288", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_min_log_runway": "1048576", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_replay_recovery": "false", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_sync_write": "false", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-20T11:36:03.890 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_allocation_from_file": "true", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_allocator": "hybrid", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_async_db_compaction": "true", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bdev_label_multi": "true", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-20T11:36:03.891 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_create": "true", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_db_create": "false", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_db_path": "", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_db_size": "0", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_path": "", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_preallocate_file": "false", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_size": "107374182400", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_wal_create": "false", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_wal_path": "", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_block_wal_size": "100663296", 2026-02-20T11:36:03.892 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bluefs": "true", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_autotune": "true", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-20T11:36:03.893 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_size": "0", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cache_type": "2q", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_clone_cow": "true", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-20T11:36:03.894 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_mode": "none", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_csum_type": "crc32c", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_freelist": "false", 2026-02-20T11:36:03.895 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-20T11:36:03.896 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_small_allocations": "0", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_default_buffered_read": "true", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_default_buffered_write": "false", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-20T11:36:03.897 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fail_eio": "false", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_mount": "false", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_umount": "false", 2026-02-20T11:36:03.898 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_ignore_data_csum": "false", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-20T11:36:03.899 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_log_op_age": "5.000000", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_alloc_size": "0", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_blob_size": "0", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_max_deferred_txc": "32", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_min_alloc_size": "0", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_nid_prealloc": "1024", 2026-02-20T11:36:03.900 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_onode_segment_size": "0", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_retry_disk_reads": "3", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_rocksdb_cf": "true", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-20T11:36:03.901 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_spdk_mem": "512", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_tracing": "false", 2026-02-20T11:36:03.902 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_write_v2": "false", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_write_v2_random": "false", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "bluestore_zero_block_detection": "false", 2026-02-20T11:36:03.903 INFO:teuthology.orchestra.run.trial046.stdout: "breakpad": "false", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "ceph_assert_supresssions": "", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-20T11:36:03.904 INFO:teuthology.orchestra.run.trial046.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_cluster_require_signatures": "false", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_cluster_require_version": "2", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_require_signatures": "false", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_require_version": "2", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_service_require_signatures": "false", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_service_require_version": "2", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "cephx_sign_messages": "true", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "chdir": "", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "client_acl_type": "", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "client_asio_thread_count": "2", 2026-02-20T11:36:03.905 INFO:teuthology.orchestra.run.trial046.stdout: "client_cache_mid": "0.750000", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_cache_size": "16384", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_caps_release_delay": "5", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_check_pool_perm": "true", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_debug_force_sync_read": "false", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_debug_getattr_caps": "false", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_debug_inject_features": "", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_debug_inject_tick_delay": "0", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_die_on_failed_remount": "false", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_dirsize_rbytes": "true", 2026-02-20T11:36:03.906 INFO:teuthology.orchestra.run.trial046.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_force_lazyio": "false", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_fs": "", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_fscrypt_as": "true", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_inject_release_failure": "false", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_inject_write_delay_secs": "0", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_max_inline_size": "4096", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-20T11:36:03.907 INFO:teuthology.orchestra.run.trial046.stdout: "client_mds_namespace": "", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_metadata": "", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_mount_gid": "-1", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_mount_timeout": "300", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_mount_uid": "-1", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_mountpoint": "/", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_notify_timeout": "10", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc": "true", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_max_dirty": "104857600", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-20T11:36:03.908 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_max_objects": "1000", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_size": "209715200", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_oc_target_dirty": "8388608", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_permissions": "true", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_quota": "true", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_quota_df": "true", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_readahead_max_bytes": "0", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_readahead_max_periods": "4", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_readahead_min": "131072", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_reconnect_stale": "false", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_shutdown_timeout": "30", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_snapdir": ".snap", 2026-02-20T11:36:03.909 INFO:teuthology.orchestra.run.trial046.stdout: "client_tick_interval": "1", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "client_trace": "", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "client_try_dentry_invalidate": "false", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "client_use_faked_inos": "false", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "client_use_random_mds": "false", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_graylog": "false", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_graylog_port": "12201", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_monitors": "default=true", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_syslog": "false", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "clog_to_syslog_level": "info", 2026-02-20T11:36:03.910 INFO:teuthology.orchestra.run.trial046.stdout: "cluster_addr": "-", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "cluster_network": "", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "cluster_network_interface": "", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "compressor_zlib_isal": "false", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "compressor_zlib_level": "5", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "compressor_zlib_winsize": "-15", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "compressor_zstd_level": "1", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_allow_pg_split": "true", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_bluestore_cpu_set": "", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_bluestore_num_threads": "6", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_cpu_num": "0", 2026-02-20T11:36:03.911 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_cpu_set": "", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_osd_obc_lru_size": "512", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_osd_stat_interval": "0", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_poll_mode": "false", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_reactor_backend": "", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crush_location": "", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crush_location_hook": "", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "crush_location_hook_timeout": "10", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "d4n_writecache_enabled": "false", 2026-02-20T11:36:03.912 INFO:teuthology.orchestra.run.trial046.stdout: "daemonize": "false", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "daos_pool": "tank", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_alienstore": "0/5", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_allow_any_pool_priority": "false", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_asok": "1/5", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_asok_assert_abort": "false", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_asserts_on_shutdown": "true", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_auth": "20/20", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_bdev": "1/3", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_bluefs": "1/5", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_bluestore": "1/5", 2026-02-20T11:36:03.913 INFO:teuthology.orchestra.run.trial046.stdout: "debug_bluestore_compression": "1/5", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_buffer": "0/1", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_ceph_dedup": "0/5", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_ceph_exporter": "1/5", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_cephfs_mirror": "0/5", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_cephsqlite": "0/5", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_client": "0/5", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_compressor": "1/5", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_context": "0/1", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_crimson_interrupt": "0/5", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_crush": "1/1", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_crypto": "1/5", 2026-02-20T11:36:03.914 INFO:teuthology.orchestra.run.trial046.stdout: "debug_cyanstore": "0/5", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_deliberately_leak_memory": "false", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_disable_randomized_ping": "false", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_dpdk": "1/5", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_eventtrace": "1/5", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_filer": "0/1", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_filestore": "1/3", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_finisher": "1/1", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_fuse": "1/5", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_heartbeat_testing_span": "0", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_heartbeatmap": "1/5", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-20T11:36:03.915 INFO:teuthology.orchestra.run.trial046.stdout: "debug_javaclient": "1/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_journal": "1/3", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_journaler": "0/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_kstore": "1/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_lockdep": "0/1", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mclock": "1/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds": "1/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_balancer": "1/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_locker": "1/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_log": "1/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_log_expire": "1/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_migrator": "1/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mds_quiesce": "3/5", 2026-02-20T11:36:03.916 INFO:teuthology.orchestra.run.trial046.stdout: "debug_memstore": "1/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mgr": "2/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mgrc": "1/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_mon": "20/20", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_monc": "0/10", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_ms": "1/1", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_none": "0/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_objclass": "0/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_objectcacher": "0/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_objecter": "0/1", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_optracker": "0/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_osd": "1/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_paxos": "20/20", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_perfcounter": "1/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_prioritycache": "1/5", 2026-02-20T11:36:03.917 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rados": "0/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rbd": "0/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rbd_mirror": "0/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rbd_pwl": "0/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rbd_replay": "0/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_refs": "0/0", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_reserver": "1/1", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw": "1/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_access": "1/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_datacache": "1/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_dbstore": "1/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_dedup": "1/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_flight": "1/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-20T11:36:03.918 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_notification": "1/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_restore": "1/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rgw_sync": "1/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_rocksdb": "4/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_backref": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_cache": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_cleaner": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_device": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_epm": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_fixedkv_tree": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_journal": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_lba": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_odata": "0/5", 2026-02-20T11:36:03.919 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_omap": "0/5", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_onode": "0/5", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_t": "0/5", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "debug_seastore_tm": "0/5", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "debug_striper": "0/1", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "debug_test": "0/5", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "debug_throttle": "1/1", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "debug_timer": "0/1", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "debug_tp": "0/5", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "debug_trace": "1/5", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "device_failure_prediction_mode": "none", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "ec_extent_cache_size": "10485760", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "ec_pdw_write_mode": "0", 2026-02-20T11:36:03.920 INFO:teuthology.orchestra.run.trial046.stdout: "enable_availability_tracking": "false", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "err_to_graylog": "false", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "err_to_journald": "false", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "err_to_stderr": "true", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "err_to_syslog": "false", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "event_tracing": "false", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_addr": "0.0.0.0", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_cert_file": "", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_http_port": "9926", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_key_file": "", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_prio_limit": "5", 2026-02-20T11:36:03.921 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_sort_metrics": "true", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "exporter_stats_period": "5", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "fake_statfs_for_testing": "0", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "fatal_signal_handlers": "true", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filer_max_purge_ops": "10", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filer_max_truncate_ops": "128", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_apply_finisher_threads": "1", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_blackhole": "false", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_btrfs_clone_range": "true", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_btrfs_snap": "true", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_caller_concurrency": "10", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_collect_device_partition_information": "true", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_commit_timeout": "600.000000", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_debug_inject_read_err": "false", 2026-02-20T11:36:03.922 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_debug_omap_check": "false", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_debug_verify_split": "false", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_dump_file": "", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fadvise": "true", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fail_eio": "true", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fd_cache_shards": "16", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fd_cache_size": "128", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fiemap": "false", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fiemap_threshold": "4096", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_inject_stall": "0", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_journal_parallel": "false", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_journal_trailing": "false", 2026-02-20T11:36:03.923 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_journal_writeahead": "false", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_kill_at": "0", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattrs": "0", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_xattr_value_size": "0", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-20T11:36:03.924 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_merge_threshold": "-10", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_odsync_write": "false", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_omap_backend": "rocksdb", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_omap_backend_path": "", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_ondisk_finisher_threads": "1", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_op_thread_timeout": "60", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_op_threads": "2", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_punch_hole": "false", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-20T11:36:03.925 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_queue_max_ops": "50", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_seek_data_hole": "false", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_sloppy_crc": "false", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_splice": "false", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_split_multiple": "2", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_split_rand_factor": "20", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_update_to": "1000", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-20T11:36:03.926 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_enable": "true", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_xfs_extsize": "false", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "filestore_zfs_snap": "false", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "fio_dir": "/tmp/fio", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "fsid": "6a7e41b7-6f36-42a8-877b-32f239584843", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_allow_other": "true", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_atomic_o_trunc": "true", 2026-02-20T11:36:03.927 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_big_writes": "true", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_debug": "false", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_default_permissions": "false", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_disable_pagecache": "false", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_max_write": "0", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_multithreaded": "true", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_require_active_mds": "true", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_set_user_groups": "true", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_splice_move": "true", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_splice_read": "true", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_splice_write": "true", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "fuse_use_invalidate_cb": "true", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "gss_target_name": "ceph", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "heartbeat_file": "", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "heartbeat_inject_failure": "0", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "heartbeat_interval": "5", 2026-02-20T11:36:03.928 INFO:teuthology.orchestra.run.trial046.stdout: "host": "trial046", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "inject_early_sigterm": "false", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "jaeger_agent_port": "6799", 2026-02-20T11:36:03.929 INFO:teuthology.orchestra.run.trial046.stdout: "jaeger_tracing_enable": "false", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_aio": "true", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_align_min_size": "65536", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_block_align": "true", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_block_size": "4096", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_dio": "true", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_discard": "false", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_force_aio": "false", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_ignore_corruption": "false", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_max_write_bytes": "10485760", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_max_write_entries": "100", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_replay_from": "0", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_write_header_frequency": "0", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journal_zero_on_create": "false", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journaler_prefetch_periods": "10", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journaler_prezero_periods": "5", 2026-02-20T11:36:03.930 INFO:teuthology.orchestra.run.trial046.stdout: "journaler_write_head_interval": "15", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "key": "", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "keyfile": "", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "librados_thread_count": "2", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "lockdep": "false", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "lockdep_force_backtrace": "false", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_coarse_timestamps": "true", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_flush_on_exit": "false", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_graylog_host": "127.0.0.1", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_graylog_port": "12201", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_max_new": "1000", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_max_recent": "10000", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_stderr_prefix": "", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_stop_at_utilization": "0.970000", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_file": "true", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_graylog": "false", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_journald": "false", 2026-02-20T11:36:03.931 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_stderr": "false", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "log_to_syslog": "false", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "max_rotating_auth_attempts": "10", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_action_on_write_error": "1", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_allow_async_dirops": "true", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_allow_batched_ops": "true", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_alternate_name_max": "8192", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_asio_thread_count": "2", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_export_pin": "true", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_fragment_dirs": "true", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_fragment_interval": "5", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_interval": "10", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_max": "-1", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_max_until": "-1", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_merge_size": "50", 2026-02-20T11:36:03.932 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_midchunk": "0.300000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_min_start": "0.200000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_minchunk": "0.001000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_mode": "0", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_need_max": "1.200000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_need_min": "0.800000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_overload_epochs": "2", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_split_bits": "3", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_split_size": "10000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_target_decay": "10.000000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_beacon_grace": "15.000000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_beacon_interval": "4.000000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_mid": "0.700000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-20T11:36:03.933 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_delay": "0", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_release_free_interval": "10", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_reservation": "0.050000", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_trim_interval": "1", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cache_trim_threshold": "262144", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_client_prealloc_inos": "1000", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_connect_bootstrapping": "false", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_damage_table_max_entries": "10000", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_debug_auth_pins": "false", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_debug_frag": "false", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_debug_scatterstat": "false", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_debug_subtrees": "false", 2026-02-20T11:36:03.934 INFO:teuthology.orchestra.run.trial046.stdout: "mds_decay_halflife": "5.000000", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_default_dir_hash": "2", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_defer_session_stale": "true", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_deny_all_reconnect": "false", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dir_keys_per_op": "16384", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dir_max_commit_size": "10", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dir_max_entries": "0", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dir_prefetch": "true", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dump_cache_on_map": "false", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_early_reply": "true", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_enable_op_tracker": "true", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_enforce_unique_name": "true", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_export_ephemeral_random": "true", 2026-02-20T11:36:03.935 INFO:teuthology.orchestra.run.trial046.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_health_summarize_threshold": "10", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_health_dummy": "false", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_migrator_session_race": "false", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_join_fs": "", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_journal_format": "1", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_create_at": "0", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_dirfrag_at": "0", 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_export_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_import_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_journal_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_journal_expire_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_journal_replay_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_link_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_mdstable_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_openc_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_rename_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_kill_shutdown_at": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_event_large_threshold": "524288", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_events_per_segment": "1024", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_max_events": "-1", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_max_segments": "128", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_pause": "false", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_segment_size": "0", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_trim_threshold": "128", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_log_warn_factor": "2.000000", 2026-02-20T11:36:03.937 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_caps_per_client": "1048576", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_completed_flushes": "100000", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_completed_requests": "100000", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_export_size": "20971520", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_file_recover": "32", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_purge_files": "64", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_purge_ops": "8192", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_max_snaps_per_dir": "100", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_metrics_update_interval": "2", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_min_caps_per_client": "100", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_min_caps_working_set": "10000", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_numa_node": "-1", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_complaint_time": "30.000000", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_history_duration": "600", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_history_size": "20", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_history_slow_op_size": "20", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_op_log_threshold": "5", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_ping_grace": "15", 2026-02-20T11:36:03.938 INFO:teuthology.orchestra.run.trial046.stdout: "mds_ping_interval": "5", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_max_caps": "30000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_recall_warning_threshold": "262144", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_replay_interval": "1.000000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_root_ino_gid": "0", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_root_ino_uid": "0", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_scrub_stats_review_period": "1", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-20T11:36:03.939 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_shutdown_check": "0", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_skip_ino": "0", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_snap_max_uid": "4294967294", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_snap_min_uid": "0", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_snap_rstat": "false", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_standby_replay_damaged": "false", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_symlink_recovery": "true", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_thrash_exports": "0", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_thrash_fragments": "0", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_tick_interval": "5.000000", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_valgrind_exit": "false", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_verify_backtrace": "1", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_verify_scatter": "false", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mds_wipe_sessions": "false", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "mempool_debug": "false", 2026-02-20T11:36:03.940 INFO:teuthology.orchestra.run.trial046.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "memstore_device_bytes": "1073741824", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "memstore_page_set": "false", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "memstore_page_size": "65536", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_client_bytes": "134217728", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_client_messages": "512", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_disabled_modules": "", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_enable_op_tracker": "true", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_max_pg_creating": "1024", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_max_pg_num_change": "128", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_mds_bytes": "134217728", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_mds_messages": "128", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_mon_bytes": "134217728", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_mon_messages": "128", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_history_duration": "600", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_history_size": "20", 2026-02-20T11:36:03.941 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_op_log_threshold": "5", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_osd_bytes": "536870912", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_osd_messages": "8192", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_pool": "true", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_standby_modules": "true", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_stats_period": "5", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_stats_threshold": "5", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_tick_period": "2", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_allow_pool_delete": "true", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_allow_pool_size_one": "true", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_auth_validate_all_caps": "true", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_bytes": "104857600", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_directed_command_retry": "2", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-20T11:36:03.942 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_on_resend": "true", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_hunt_parallel": "3", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_log_interval": "1.000000", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_ping_interval": "10.000000", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_client_target_rank": "-1", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_level": "debug", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_file": "true", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_journald": "false", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_compact_on_bootstrap": "false", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_compact_on_start": "false", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_compact_on_trim": "true", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_cpu_threads": "4", 2026-02-20T11:36:03.943 INFO:teuthology.orchestra.run.trial046.stdout: "mon_crush_min_required_version": "hammer", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_daemon_bytes": "419430400", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_data_avail_crit": "5", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_data_avail_warn": "5", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_data_size_warn": "16106127360", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_dump_json": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_dump_transactions": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_extra_checks": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_no_require_squid": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_down_added_grace": "180", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_down_mkfs_grace": "120", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_down_uptime_grace": "60", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_election_default_strategy": "1", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_election_timeout": "5.000000", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_elector_ping_divisor": "2", 2026-02-20T11:36:03.944 INFO:teuthology.orchestra.run.trial046.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_enable_op_tracker": "true", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_fake_pool_delete": "false", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_force_quorum_join": "false", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_globalid_prealloc": "10000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_detail_to_clog": "false", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_log_update_period": "5", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_max_detail": "50", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_to_clog": "true", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_to_clog_interval": "600", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_host": "10.20.193.46", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_host_override": "", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_initial_members": "", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_lease": "5.000000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_log_full_interval": "50", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_log_max": "10000", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_log_max_summary": "50", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-20T11:36:03.945 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_log_epochs": "500", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_osd": "10000", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_pg_per_osd": "10000", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_pool_pg_num": "65536", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mds_force_trim_to": "0", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mds_skip_sanity": "false", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_memory_autotune": "true", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_memory_target": "2147483648", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_beacon_grace": "30", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_digest_period": "5", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_inactive_grace": "60", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_mkfs_grace": "240", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_min_osdmap_epochs": "50", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_netsplit_grace_period": "9", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-20T11:36:03.946 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_complaint_time": "30", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_history_duration": "600", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_history_size": "20", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_history_slow_op_size": "20", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_op_log_threshold": "5", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_auto_mark_in": "false", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_cache_size": "500", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_down_out_interval": "600", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_force_trim_to": "0", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-20T11:36:03.947 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_min_down_reporters": "2", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_report_timeout": "900", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_reporter_subtree_level": "osd", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osdmap_full_prune_interval": "2", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osdmap_full_prune_min": "15", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_osdmap_full_prune_txsize": "2", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_stuck_threshold": "60", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_probe_timeout": "2.000000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_reweight_max_change": "0.050000", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_reweight_max_osds": "4", 2026-02-20T11:36:03.948 INFO:teuthology.orchestra.run.trial046.stdout: "mon_reweight_min_bytes_per_osd": "10", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_reweight_min_pgs_per_osd": "4", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_interval": "86400", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_max_keys": "100", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_scrub_timeout": "300", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_session_timeout": "300", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_smart_report_timeout": "5", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stat_smooth_intervals": "6", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stretch_pool_min_size": "2", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stretch_pool_size": "4", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_debug": "false", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_provider_kill_at": "0", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_requester_kill_at": "0", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_sync_timeout": "60.000000", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_target_pg_per_osd": "100", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_tick_interval": "5", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_timecheck_interval": "300.000000", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_use_min_delay_socket": "false", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_older_version_delay": "604800", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-20T11:36:03.949 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_filestore_osds": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_misplaced": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_older_version": "true", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_pool_no_redundancy": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "monmap": "", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "motr_tracing_enabled": "false", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_op_threads": "3", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-20T11:36:03.950 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_cm": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_device_name": "", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_dscp": "96", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_local_gid": "", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_port_num": "1", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_sl": "3", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_support_srq": "true", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_rdma_type": "ib", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_async_reap_threshold": "5", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_before_connect": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_ipv4": "true", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_ipv6": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_msgr1": "true", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_msgr2": "true", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_port_max": "7568", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_port_min": "6800", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_retry_count": "3", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_bind_retry_delay": "5", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_client": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_mds": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_mgr": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_mon": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_blackhole_osd": "false", 2026-02-20T11:36:03.951 INFO:teuthology.orchestra.run.trial046.stdout: "ms_client_mode": "crc", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_cluster_mode": "crc", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_cluster_type": "", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_compress_secure": "false", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_connection_idle_timeout": "900", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_connection_ready_timeout": "10", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_crc_data": "true", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_crc_header": "true", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_bad_msg": "false", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_bug": "true", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_old_message": "true", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_skipped_message": "false", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_coremask": "0xF", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_enable_tso": "true", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_hugepages": "", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_lro": "true", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_memory_channel": "4", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_pmd": "", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_port_id": "0", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_dump_on_send": "false", 2026-02-20T11:36:03.952 INFO:teuthology.orchestra.run.trial046.stdout: "ms_initial_backoff": "0.200000", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_delay_max": "1.000000", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_delay_type": "", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_network_congestion": "0", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_inject_socket_failures": "0", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_learn_addr_from_peer": "true", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_max_accept_failures": "4", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_max_backoff": "15.000000", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_mon_client_mode": "crc", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_mon_cluster_mode": "crc", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_mon_service_mode": "crc", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_osd_compress_min_size": "1024", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_osd_compress_mode": "none", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_pq_min_cost": "65536", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_public_type": "", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_service_mode": "crc", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_tcp_listen_backlog": "512", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_tcp_nodelay": "true", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_tcp_rcvbuf": "0", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "ms_type": "async+posix", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "no_config_file": "false", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-20T11:36:03.953 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_completion_locks_per_session": "32", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_inflight_ops": "1024", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_tick_interval": "5.000000", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "objecter_timeout": "10.000000", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "objectstore_blackhole": "false", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "openssl_conf": "", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_delay_time": "5.000000", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_hist_halflife": "1000", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_max_low_ops": "2", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_max_ops": "4", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_agent_slop": "0.020000", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_asio_thread_count": "2", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_async_recovery_min_cost": "100", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backfill_scan_max": "512", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backfill_scan_min": "64", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backoff_on_degraded": "false", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backoff_on_peering": "false", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_backoff_on_unfound": "true", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_beacon_report_interval": "300", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_bench_duration": "30", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-20T11:36:03.954 INFO:teuthology.orchestra.run.trial046.stdout: "osd_bench_max_block_size": "67108864", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_blkin_trace_all": "false", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_check_for_log_corruption": "false", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_class_update_on_start": "true", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_client_message_cap": "256", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_client_message_size_cap": "524288000", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_client_op_priority": "63", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_client_watch_timeout": "30", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_command_max_records": "256", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_compact_on_start": "false", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_crush_chooseleaf_type": "0", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_crush_update_on_start": "true", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_crush_update_weight_set": "true", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_feed_pullee": "-1", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-20T11:36:03.955 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_misdirected_ops": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_no_acting_change": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_no_purge_strays": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_op_order": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_pg_log_writeout": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_shutdown": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_trim_objects": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_verify_snaps": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_debug_verify_stray_on_activate": "false", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_keys": "1024", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_default_data_pool_replay_window": "5", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_default_notify_timeout": "30", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_delete_sleep": "0.000000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_discard_disconnected_ops": "true", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_ec_partial_reads": "true", 2026-02-20T11:36:03.956 INFO:teuthology.orchestra.run.trial046.stdout: "osd_enable_op_tracker": "true", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_info": "true", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_shutdown": "true", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_function_tracing": "false", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_grace": "20", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_interval": "6", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_min_peers": "10", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_min_size": "2000", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_stale": "600", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_hit_set_max_size": "100000", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_hit_set_min_size": "1000", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_journal_size": "5120", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_kill_backfill_at": "0", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_cache_size": "50", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_dedup": "true", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_message_max": "40", 2026-02-20T11:36:03.957 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_map_share_max_epochs": "40", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_attr_name_len": "100", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_attr_size": "0", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_backfills": "1", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_markdown_count": "5", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_markdown_period": "600", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_object_name_len": "2048", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_object_namespace_len": "256", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_object_size": "134217728", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_pg_blocked_by": "16", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_pg_log_entries": "10000", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_pgls": "1024", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_push_cost": "8388608", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_push_objects": "10", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_scrubs": "3", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_trimming_pgs": "2", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_write_op_reply_len": "64", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_max_write_size": "90", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_profile": "balanced", 2026-02-20T11:36:03.958 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mclock_skip_benchmark": "false", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_base": "805306368", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_cache_min": "134217728", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_target": "4294967296", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_target_autotune": "false", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_min_pg_log_entries": "250", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_min_recovery_priority": "0", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_report_interval": "5", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_num_cache_shards": "32", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_num_op_tracker_shard": "32", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_numa_auto_affinity": "true", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_numa_node": "-1", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_numa_prefer_iface": "true", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objecter_finishers": "1", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objectstore": "bluestore", 2026-02-20T11:36:03.959 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objectstore_fuse": "false", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_objectstore_tracing": "false", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_complaint_time": "30.000000", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_history_duration": "600", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_history_size": "20", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_history_slow_op_size": "20", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_log_threshold": "5", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_shards": "0", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_shards_hdd": "1", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_shards_ssd": "8", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_pq_min_cost": "65536", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_queue_cut_off": "high", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_op_thread_timeout": "15", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_open_classes_on_start": "true", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_os_flags": "0", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_peering_op_priority": "255", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_delete_cost": "1048576", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_delete_priority": "5", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_log_trim_max": "10000", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_log_trim_min": "100", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-20T11:36:03.960 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_crimson": "true", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_flags": "0", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_min_size": "2", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_pg_num": "32", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_pgp_num": "0", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_read_ratio": "70", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_size": "3", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_default_type": "replicated", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_push_per_object_cost": "1000", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recover_clone_overlap": "true", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_cost": "20971520", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_active": "0", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-20T11:36:03.961 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_chunk": "8388608", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_max_single_start": "1", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_op_priority": "3", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_priority": "5", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep": "0.000000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_requested_scrub_priority": "5", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_auto_repair": "false", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_begin_hour": "0", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_begin_week_day": "0", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_chunk_max": "15", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_chunk_min": "5", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_cost": "52428800", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_during_recovery": "false", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_end_hour": "0", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_end_week_day": "0", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_event_cost": "4096", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_invalid_stats": "true", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_load_threshold": "10.000000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_max_interval": "604800.000000", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_max_preemptions": "5", 2026-02-20T11:36:03.962 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_priority": "5", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_delay": "30", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_retry_trimming": "10", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_scrub_sleep": "0.000000", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_skip_data_digest": "false", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_smart_report_timeout": "5", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_cost": "1048576", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_priority": "5", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_target_transaction_size": "30", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-20T11:36:03.963 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "osd_tracing": "false", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "osd_use_stale_snap": "false", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "osdc_blkin_trace_all": "false", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_kill_at": "0", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_max_join_drift": "10", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_min": "500", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_min_wait": "0.050000", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_propose_interval": "1.000000", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_service_trim_max": "500", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_service_trim_min": "10", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_stash_full_interval": "25", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_trim_max": "500", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "paxos_trim_min": "250", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "perf": "true", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "pool_availability_update_interval": "1.000000", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "public_addr": "-", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "public_addrv": "", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "public_bind_addr": "-", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "public_network": "", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "public_network_interface": "", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "qat_compressor_busy_polling": "false", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "qat_compressor_enabled": "false", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "qat_compressor_session_max_number": "256", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "rados_mon_op_timeout": "0", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "rados_osd_op_timeout": "0", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "rados_replica_read_policy": "default", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "rados_tracing": "false", 2026-02-20T11:36:03.964 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_atime_update_interval": "60", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_balance_parent_reads": "false", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_balance_snap_reads": "false", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_blkin_trace_all": "false", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache": "true", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_policy": "writearound", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_size": "33554432", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_clone_copy_on_read": "false", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_compression_hint": "none", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_concurrent_management_ops": "10", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_clone_format": "auto", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_data_pool": "", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_features": "61", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_format": "2", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_map_options": "", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_order": "22", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_pool": "rbd", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_stripe_count": "0", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_default_stripe_unit": "0", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_enable_alloc_hint": "true", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_io_scheduler": "simple", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-20T11:36:03.965 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_order": "24", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_pool": "", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_journal_splay_width": "4", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_localize_parent_reads": "false", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_localize_snap_reads": "false", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-20T11:36:03.966 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_mtime_update_interval": "60", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_non_blocking_aio": "true", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_op_thread_timeout": "60", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_op_threads": "1", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_parent_cache_enabled": "false", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_plugins": "", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_bps_burst": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_bps_limit": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_exclude_ops": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_iops_burst": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_iops_limit": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_read_from_replica_policy": "default", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-20T11:36:03.967 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_skip_partial_discard": "true", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_tracing": "false", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_validate_names": "true", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rbd_validate_pool": "true", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "restapi_base_url": "", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "restapi_log_level": "", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_acl_grants_max_num": "100", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_admin_entry": "admin", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_asio_assert_yielding": "false", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_backend_store": "rados", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_barbican_url": "", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_beast_enable_async": "true", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_counters_cache": "false", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_eexist_override": "false", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cache_enabled": "true", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cache_expiry_interval": "900", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cache_lru_size": "25000", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_config_store": "rados", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_content_length_compat": "false", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_copy_obj_progress": "true", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cors_rules_max_num": "100", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_cross_domain_policy": "", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_addr": "", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-20T11:36:03.968 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_password": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_kmip_username": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_require_ssl": "true", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_addr": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_auth": "token", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_namespace": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_prefix": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_token_file": "", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_buffersize": "524288", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_low_speed_time": "300", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-20T11:36:03.969 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_log_changes_size": "1000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_log_num_shards": "128", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_log_window": "30", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_disable_s3select": "false", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-20T11:36:03.970 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dns_name": "", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dns_s3website_name": "", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dynamic_resharding": "true", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_gc_threads": "true", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_lc_threads": "true", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_mdsearch": "true", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_ops_log": "false", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_quota_threads": "true", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_restore_threads": "true", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_static_website": "false", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enable_usage_log": "false", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_enforce_swift_acls": "true", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_exit_timeout_secs": "120", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_expose_bucket": "false", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_extended_http_attrs": "", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_filter": "none", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_frontends": "beast port=7480", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_deferred": "50", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_objs": "32", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_gc_processor_period": "3600", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_graceful_stop": "false", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-20T11:36:03.971 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_init_timeout": "300", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_kafka_connection_idle": "300", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_domain": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_password": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_password_path": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_project": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_tenant": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_admin_user": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_domain": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_password": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_project": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_barbican_user": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_url": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_debug_interval": "-1", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_list_cnt": "1000", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_lock_max_time": "90", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_max_objs": "32", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_max_rules": "1000", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_max_worker": "3", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lc_thread_delay": "0", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_dnattr": "uid", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_searchfilter": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ldap_uri": "", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-20T11:36:03.972 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_log_http_headers": "", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_log_object_name_utc": "false", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lua_enable": "true", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_attr_name_len": "0", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_attr_size": "0", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_chunk_size": "4194304", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_control_aio": "8", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_listing_results": "5000", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_notify_retries": "10", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_put_param_size": "1048576", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_put_size": "5368709120", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_max_slo_entries": "1000", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_md_log_max_shards": "64", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_mp_lock_max_time": "600", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_max_gc": "300", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-20T11:36:03.973 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_num_async_rados_threads": "32", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_num_control_oids": "8", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_numa_node": "-1", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_objexp_chunk_size": "100", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_objexp_gc_interval": "600", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_op_thread_timeout": "600", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_op_tracing": "false", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_opa_token": "", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_opa_url": "", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_opa_verify_ssl": "true", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ops_log_rados": "false", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ops_log_socket_path": "", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_period_push_interval": "2.000000", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_cache_lanes": "3", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_cache_partitions": "3", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_print_continue": "true", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_rados_tracing": "false", 2026-02-20T11:36:03.974 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_ratelimit_interval": "60", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_realm": "", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_realm_id": "", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_region": "", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_request_uri": "", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_batch_size": "64", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_max_aio": "128", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_num_logs": "16", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshard_thread_interval": "600", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_resolve_cname": "false", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_restore_debug_interval": "-1", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_restore_lock_max_time": "90", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_restore_max_objs": "32", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_restore_processor_period": "900", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_run_sync_thread": "true", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_scheduler_type": "throttler", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_script_uri": "", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_service_provider_name": "", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_client_id": "", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_client_secret": "", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_entry": "sts", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_key": "", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_min_session_duration": "900", 2026-02-20T11:36:03.975 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sts_token_introspection_url": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_account_in_url": "false", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_auth_entry": "auth", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_auth_url": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_custom_header": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_need_stats": "true", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_tenant_name": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_token_expiration": "86400", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_url": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_url_prefix": "swift", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_lease_period": "120", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_thread_pool_size": "512", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_comment": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_createby": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_encoding": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_flag": "false", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_origin": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_torrent_tracker": "", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_trust_forwarded_https": "false", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_log_key_transition": "true", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_max_shards": "32", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_usage_max_user_shards": "1", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_use_opa_authz": "false", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_counters_cache": "false", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-20T11:36:03.976 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_max_buckets": "1000", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_policies_max_num": "100", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_user_unique_email": "true", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_verify_ssl": "true", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zone": "", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zone_id": "", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zonegroup": "", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zonegroup_id": "", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgwlc_auto_session_clear": "true", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_block_size": "4096", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_size": "536870912", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_index_type": "binary_search", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_partition_filters": "false", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_perf": "false", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "run_dir": "/var/run/ceph", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_block_create": "true", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cachepin_size_pershard": "2147483648", 2026-02-20T11:36:03.977 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cachepin_type": "LRU", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_cold_tier_generations": "3", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_default_max_object_size": "16777216", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_device_size": "53687091200", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_full_integrity_check": "false", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_hot_tier_generations": "5", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_journal_batch_capacity": "16", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_main_device_type": "SSD", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_max_concurrent_transactions": "128", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_max_data_allocation_size": "0", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "seastore_segment_size": "67108864", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "service_unique_id": "", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "set_keepcaps": "false", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "setgroup": "", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "setuser": "", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "setuser_match_path": "", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "subv_metrics_window_interval": "30", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "thp": "false", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "threadpool_default_timeout": "60", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "throttler_perf_counter": "true", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "tmp_dir": "/tmp", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "uadk_compressor_enabled": "false", 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-20T11:36:03.978 INFO:teuthology.orchestra.run.trial046.stdout:} 2026-02-20T11:36:03.979 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2026-02-20T11:36:04.057 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:04.054+0000 7f62a3ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:04.059 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:04.057+0000 7f62a3ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:04.068 INFO:teuthology.orchestra.run.trial046.stdout:{} 2026-02-20T11:36:04.068 INFO:teuthology.orchestra.run.trial046.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-20T11:36:04.076 DEBUG:teuthology.orchestra.run.trial046:> type ceph-objectstore-tool 2026-02-20T11:36:04.091 INFO:teuthology.orchestra.run.trial046.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T11:36:04.092 DEBUG:teuthology.orchestra.run.trial086:> type ceph-objectstore-tool 2026-02-20T11:36:04.110 INFO:teuthology.orchestra.run.trial086.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T11:36:04.110 INFO:teuthology.run_tasks:Running task rados... 2026-02-20T11:36:04.131 INFO:tasks.rados:Beginning rados... 2026-02-20T11:36:04.132 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 0, 'delete': 50, 'read': 100, 'rollback': 0, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-20T11:36:04.132 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}} 2026-02-20T11:36:04.132 INFO:tasks.rados:config is {'clients': ['client.0'], 'objects': 50, 'op_weights': {'copy_from': 0, 'delete': 50, 'read': 100, 'rollback': 0, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000} 2026-02-20T11:36:04.132 DEBUG:teuthology.run_tasks:Unwinding manager rados 2026-02-20T11:36:04.146 INFO:tasks.rados:joining rados 2026-02-20T11:36:04.146 INFO:tasks.thrashosds.thrasher:starting do_thrash 2026-02-20T11:36:04.146 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-20T11:36:04.146 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:36:04.147 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:36:04.147 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2026-02-20T11:36:04.148 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:04.148 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2026-02-20T11:36:04.148 INFO:tasks.rados:starting run 0 out of 1 2026-02-20T11:36:04.148 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-20T11:36:04.149 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-20T11:36:04.230 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:04.226+0000 7f2050c8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:04.230 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:04.226+0000 7f199cc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:04.232 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:04.226+0000 7fc2c2f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:04.233 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:04.230+0000 7f2050c8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:04.233 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:04.231+0000 7f199cc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:04.235 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:04.233+0000 7fc2c2f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:04.347 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:04.348 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-20T11:36:04.358 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-20T11:36:03.973584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":4056,"kb_used_data":4056,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208662568,"statfs":{"total":213674622976,"available":213670469632,"internally_reserved":0,"allocated":4153344,"data_stored":4153344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.952491"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021390+0000","last_change":"2026-02-20T11:36:01.025256+0000","last_active":"2026-02-20T11:36:01.021390+0000","last_peered":"2026-02-20T11:36:01.021390+0000","last_clean":"2026-02-20T11:36:01.021390+0000","last_became_active":"2026-02-20T11:35:59.082337+0000","last_became_peered":"2026-02-20T11:35:59.082337+0000","last_unstale":"2026-02-20T11:36:01.021390+0000","last_undegraded":"2026-02-20T11:36:01.021390+0000","last_fullsized":"2026-02-20T11:36:01.021390+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021117+0000","last_change":"2026-02-20T11:36:01.025173+0000","last_active":"2026-02-20T11:36:01.021117+0000","last_peered":"2026-02-20T11:36:01.021117+0000","last_clean":"2026-02-20T11:36:01.021117+0000","last_became_active":"2026-02-20T11:35:59.055623+0000","last_became_peered":"2026-02-20T11:35:59.055623+0000","last_unstale":"2026-02-20T11:36:01.021117+0000","last_undegraded":"2026-02-20T11:36:01.021117+0000","last_fullsized":"2026-02-20T11:36:01.021117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021120+0000","last_change":"2026-02-20T11:36:01.023609+0000","last_active":"2026-02-20T11:36:01.021120+0000","last_peered":"2026-02-20T11:36:01.021120+0000","last_clean":"2026-02-20T11:36:01.021120+0000","last_became_active":"2026-02-20T11:35:59.044553+0000","last_became_peered":"2026-02-20T11:35:59.044553+0000","last_unstale":"2026-02-20T11:36:01.021120+0000","last_undegraded":"2026-02-20T11:36:01.021120+0000","last_fullsized":"2026-02-20T11:36:01.021120+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019704+0000","last_change":"2026-02-20T11:36:01.022149+0000","last_active":"2026-02-20T11:36:01.019704+0000","last_peered":"2026-02-20T11:36:01.019704+0000","last_clean":"2026-02-20T11:36:01.019704+0000","last_became_active":"2026-02-20T11:35:59.065276+0000","last_became_peered":"2026-02-20T11:35:59.065276+0000","last_unstale":"2026-02-20T11:36:01.019704+0000","last_undegraded":"2026-02-20T11:36:01.019704+0000","last_fullsized":"2026-02-20T11:36:01.019704+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019253+0000","last_change":"2026-02-20T11:35:59.060440+0000","last_active":"2026-02-20T11:36:01.019253+0000","last_peered":"2026-02-20T11:36:01.019253+0000","last_clean":"2026-02-20T11:36:01.019253+0000","last_became_active":"2026-02-20T11:35:59.043888+0000","last_became_peered":"2026-02-20T11:35:59.043888+0000","last_unstale":"2026-02-20T11:36:01.019253+0000","last_undegraded":"2026-02-20T11:36:01.019253+0000","last_fullsized":"2026-02-20T11:36:01.019253+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.017868+0000","last_change":"2026-02-20T11:36:01.021350+0000","last_active":"2026-02-20T11:36:01.017868+0000","last_peered":"2026-02-20T11:36:01.017868+0000","last_clean":"2026-02-20T11:36:01.017868+0000","last_became_active":"2026-02-20T11:35:59.059484+0000","last_became_peered":"2026-02-20T11:35:59.059484+0000","last_unstale":"2026-02-20T11:36:01.017868+0000","last_undegraded":"2026-02-20T11:36:01.017868+0000","last_fullsized":"2026-02-20T11:36:01.017868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.022784+0000","last_change":"2026-02-20T11:36:01.022784+0000","last_active":"2026-02-20T11:36:01.022784+0000","last_peered":"2026-02-20T11:36:01.022784+0000","last_clean":"2026-02-20T11:36:01.022784+0000","last_became_active":"2026-02-20T11:35:59.048324+0000","last_became_peered":"2026-02-20T11:35:59.048324+0000","last_unstale":"2026-02-20T11:36:01.022784+0000","last_undegraded":"2026-02-20T11:36:01.022784+0000","last_fullsized":"2026-02-20T11:36:01.022784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.021084+0000","last_change":"2026-02-20T11:36:01.023332+0000","last_active":"2026-02-20T11:36:01.021084+0000","last_peered":"2026-02-20T11:36:01.021084+0000","last_clean":"2026-02-20T11:36:01.021084+0000","last_became_active":"2026-02-20T11:35:59.046602+0000","last_became_peered":"2026-02-20T11:35:59.046602+0000","last_unstale":"2026-02-20T11:36:01.021084+0000","last_undegraded":"2026-02-20T11:36:01.021084+0000","last_fullsized":"2026-02-20T11:36:01.021084+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:36:01.019792+0000","last_change":"2026-02-20T11:36:01.022683+0000","last_active":"2026-02-20T11:36:01.019792+0000","last_peered":"2026-02-20T11:36:01.019792+0000","last_clean":"2026-02-20T11:36:01.019792+0000","last_became_active":"2026-02-20T11:35:59.079114+0000","last_became_peered":"2026-02-20T11:35:59.079114+0000","last_unstale":"2026-02-20T11:36:01.019792+0000","last_undegraded":"2026-02-20T11:36:01.019792+0000","last_fullsized":"2026-02-20T11:36:01.019792+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160253014016,"internally_reserved":0,"allocated":2953216,"data_stored":2953216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1268,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165388,"statfs":{"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":480,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52166176,"statfs":{"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1136,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165520,"statfs":{"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":1172,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165484,"statfs":{"total":53418655744,"available":53417455616,"internally_reserved":0,"allocated":1200128,"data_stored":1200128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53418655744,"available":53417492480,"internally_reserved":0,"allocated":1163264,"data_stored":1163264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53418164224,"internally_reserved":0,"allocated":491520,"data_stored":491520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53417357312,"internally_reserved":0,"allocated":1298432,"data_stored":1298432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:36:05.206 INFO:teuthology.orchestra.run.trial046.stderr:pool 'unique_pool_0' created 2026-02-20T11:36:05.220 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-20T11:36:05.302 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:05.295+0000 7fa22bf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:05.305 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:05.303+0000 7fa22bf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:06.210 INFO:teuthology.orchestra.run.trial046.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-20T11:36:06.296 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:06.374 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:06.371+0000 7fce6fecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:06.377 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:06.375+0000 7fce6fecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:07.225 DEBUG:teuthology.orchestra.run.trial046:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 0 --op copy_from 0 --op write_excl 50 --pool unique_pool_0 2026-02-20T11:36:07.274 INFO:tasks.rados.rados.0.trial046.stdout:adding op weight read -> 100 2026-02-20T11:36:07.274 INFO:tasks.rados.rados.0.trial046.stdout:adding op weight write -> 50 2026-02-20T11:36:07.274 INFO:tasks.rados.rados.0.trial046.stdout:adding op weight delete -> 50 2026-02-20T11:36:07.274 INFO:tasks.rados.rados.0.trial046.stdout:adding op weight snap_create -> 50 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout:adding op weight snap_remove -> 50 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout:adding op weight write_excl -> 50 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout:ceph version 20.3.0-5357-g0c3148ca (0c3148ca19c827ca2a7a9b92c2554d99507fd1f4) tentacle (dev - Debug) 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout:Configuration: 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout: Number of operations: 4000 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout: Number of objects: 50 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout: Max in flight operations: 16 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout: Object size (in bytes): 4000000 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout: Write stride min: 400000 2026-02-20T11:36:07.275 INFO:tasks.rados.rados.0.trial046.stdout: Write stride max: 800000 2026-02-20T11:36:08.218 INFO:tasks.rados.rados.0.trial046.stdout:1: write initial oid 1 2026-02-20T11:36:08.218 INFO:tasks.rados.rados.0.trial046.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2026-02-20T11:36:08.221 INFO:tasks.rados.rados.0.trial046.stdout:1: writing trial04641590-1 from 416807 to 892056 tid 1 2026-02-20T11:36:08.227 INFO:tasks.rados.rados.0.trial046.stdout:1: writing trial04641590-1 from 1542129 to 2016807 tid 2 2026-02-20T11:36:08.227 INFO:tasks.rados.rados.0.trial046.stdout:2: write initial oid 2 2026-02-20T11:36:08.227 INFO:tasks.rados.rados.0.trial046.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2026-02-20T11:36:08.231 INFO:tasks.rados.rados.0.trial046.stdout:2: writing trial04641590-2 from 416807 to 892056 tid 1 2026-02-20T11:36:08.236 INFO:tasks.rados.rados.0.trial046.stdout:2: writing trial04641590-2 from 1542129 to 2016807 tid 2 2026-02-20T11:36:08.236 INFO:tasks.rados.rados.0.trial046.stdout:3: write initial oid 3 2026-02-20T11:36:08.236 INFO:tasks.rados.rados.0.trial046.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2026-02-20T11:36:08.239 INFO:tasks.rados.rados.0.trial046.stdout:3: writing trial04641590-3 from 433614 to 984112 tid 1 2026-02-20T11:36:08.244 INFO:tasks.rados.rados.0.trial046.stdout:3: writing trial04641590-3 from 1600611 to 2033614 tid 2 2026-02-20T11:36:08.244 INFO:tasks.rados.rados.0.trial046.stdout:4: write initial oid 4 2026-02-20T11:36:08.244 INFO:tasks.rados.rados.0.trial046.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2026-02-20T11:36:08.248 INFO:tasks.rados.rados.0.trial046.stdout:4: writing trial04641590-4 from 450421 to 1076168 tid 1 2026-02-20T11:36:08.252 INFO:tasks.rados.rados.0.trial046.stdout:4: writing trial04641590-4 from 1659093 to 2050421 tid 2 2026-02-20T11:36:08.252 INFO:tasks.rados.rados.0.trial046.stdout:5: write initial oid 5 2026-02-20T11:36:08.252 INFO:tasks.rados.rados.0.trial046.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2026-02-20T11:36:08.257 INFO:tasks.rados.rados.0.trial046.stdout:5: writing trial04641590-5 from 467228 to 1168224 tid 1 2026-02-20T11:36:08.260 INFO:tasks.rados.rados.0.trial046.stdout:5: writing trial04641590-5 from 1717575 to 2067228 tid 2 2026-02-20T11:36:08.260 INFO:tasks.rados.rados.0.trial046.stdout:6: write initial oid 6 2026-02-20T11:36:08.261 INFO:tasks.rados.rados.0.trial046.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2026-02-20T11:36:08.265 INFO:tasks.rados.rados.0.trial046.stdout:6: writing trial04641590-6 from 484035 to 1260280 tid 1 2026-02-20T11:36:08.268 INFO:tasks.rados.rados.0.trial046.stdout:6: writing trial04641590-6 from 2059704 to 2084035 tid 2 2026-02-20T11:36:08.269 INFO:tasks.rados.rados.0.trial046.stdout:7: write initial oid 7 2026-02-20T11:36:08.269 INFO:tasks.rados.rados.0.trial046.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2026-02-20T11:36:08.272 INFO:tasks.rados.rados.0.trial046.stdout:7: writing trial04641590-7 from 500842 to 952336 tid 1 2026-02-20T11:36:08.276 INFO:tasks.rados.rados.0.trial046.stdout:7: writing trial04641590-7 from 1718186 to 2100842 tid 2 2026-02-20T11:36:08.277 INFO:tasks.rados.rados.0.trial046.stdout:8: write initial oid 8 2026-02-20T11:36:08.277 INFO:tasks.rados.rados.0.trial046.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2026-02-20T11:36:08.280 INFO:tasks.rados.rados.0.trial046.stdout:8: writing trial04641590-8 from 517649 to 1044392 tid 1 2026-02-20T11:36:08.284 INFO:tasks.rados.rados.0.trial046.stdout:8: writing trial04641590-8 from 1776668 to 2117649 tid 2 2026-02-20T11:36:08.285 INFO:tasks.rados.rados.0.trial046.stdout:9: write initial oid 9 2026-02-20T11:36:08.285 INFO:tasks.rados.rados.0.trial046.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2026-02-20T11:36:08.289 INFO:tasks.rados.rados.0.trial046.stdout:9: writing trial04641590-9 from 534456 to 1252801 tid 1 2026-02-20T11:36:08.293 INFO:tasks.rados.rados.0.trial046.stdout:9: writing trial04641590-9 from 1951503 to 2134456 tid 2 2026-02-20T11:36:08.293 INFO:tasks.rados.rados.0.trial046.stdout:10: write initial oid 10 2026-02-20T11:36:08.293 INFO:tasks.rados.rados.0.trial046.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2026-02-20T11:36:08.298 INFO:tasks.rados.rados.0.trial046.stdout:10: writing trial04641590-10 from 551263 to 1344857 tid 1 2026-02-20T11:36:08.301 INFO:tasks.rados.rados.0.trial046.stdout:10: writing trial04641590-10 from 1893632 to 2151263 tid 2 2026-02-20T11:36:08.301 INFO:tasks.rados.rados.0.trial046.stdout:11: write initial oid 11 2026-02-20T11:36:08.301 INFO:tasks.rados.rados.0.trial046.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2026-02-20T11:36:08.305 INFO:tasks.rados.rados.0.trial046.stdout:11: writing trial04641590-11 from 568070 to 1036913 tid 1 2026-02-20T11:36:08.310 INFO:tasks.rados.rados.0.trial046.stdout:11: writing trial04641590-11 from 1552114 to 2168070 tid 2 2026-02-20T11:36:08.310 INFO:tasks.rados.rados.0.trial046.stdout:12: write initial oid 12 2026-02-20T11:36:08.310 INFO:tasks.rados.rados.0.trial046.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2026-02-20T11:36:08.314 INFO:tasks.rados.rados.0.trial046.stdout:12: writing trial04641590-12 from 584877 to 1128969 tid 1 2026-02-20T11:36:08.318 INFO:tasks.rados.rados.0.trial046.stdout:12: writing trial04641590-12 from 1610596 to 2172599 tid 2 2026-02-20T11:36:08.318 INFO:tasks.rados.rados.0.trial046.stdout:13: write initial oid 13 2026-02-20T11:36:08.319 INFO:tasks.rados.rados.0.trial046.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2026-02-20T11:36:08.324 INFO:tasks.rados.rados.0.trial046.stdout:13: writing trial04641590-13 from 601684 to 1221025 tid 1 2026-02-20T11:36:08.328 INFO:tasks.rados.rados.0.trial046.stdout:13: writing trial04641590-13 from 1669078 to 2201684 tid 2 2026-02-20T11:36:08.328 INFO:tasks.rados.rados.0.trial046.stdout:14: write initial oid 14 2026-02-20T11:36:08.328 INFO:tasks.rados.rados.0.trial046.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2026-02-20T11:36:08.333 INFO:tasks.rados.rados.0.trial046.stdout:14: writing trial04641590-14 from 618491 to 1313081 tid 1 2026-02-20T11:36:08.336 INFO:tasks.rados.rados.0.trial046.stdout:14: writing trial04641590-14 from 2011207 to 2218491 tid 2 2026-02-20T11:36:08.336 INFO:tasks.rados.rados.0.trial046.stdout:15: write initial oid 15 2026-02-20T11:36:08.337 INFO:tasks.rados.rados.0.trial046.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2026-02-20T11:36:08.342 INFO:tasks.rados.rados.0.trial046.stdout:15: writing trial04641590-15 from 635298 to 1405137 tid 1 2026-02-20T11:36:08.345 INFO:tasks.rados.rados.0.trial046.stdout:15: writing trial04641590-15 from 2069689 to 2235298 tid 2 2026-02-20T11:36:08.345 INFO:tasks.rados.rados.0.trial046.stdout:16: write initial oid 16 2026-02-20T11:36:08.345 INFO:tasks.rados.rados.0.trial046.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2026-02-20T11:36:08.349 INFO:tasks.rados.rados.0.trial046.stdout:16: writing trial04641590-16 from 652105 to 1097193 tid 1 2026-02-20T11:36:08.354 INFO:tasks.rados.rados.0.trial046.stdout:16: writing trial04641590-16 from 1728171 to 2181159 tid 2 2026-02-20T11:36:08.354 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.354 INFO:tasks.rados.rados.0.trial046.stdout:1: finishing write tid 1 to trial04641590-1 2026-02-20T11:36:08.354 INFO:tasks.rados.rados.0.trial046.stdout:2: finishing write tid 1 to trial04641590-2 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:2: finishing write tid 2 to trial04641590-2 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:2: finishing write tid 3 to trial04641590-2 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:2: finishing write tid 4 to trial04641590-2 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:2: oid 2 updating version 0 to 3 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:2: oid 2 version 3 is already newer than 1 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:2: oid 2 version 3 is already newer than 3 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:3: finishing write tid 1 to trial04641590-3 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:1: finishing write tid 2 to trial04641590-1 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:1: finishing write tid 3 to trial04641590-1 2026-02-20T11:36:08.355 INFO:tasks.rados.rados.0.trial046.stdout:2: done (15 left) 2026-02-20T11:36:08.356 INFO:tasks.rados.rados.0.trial046.stdout:17: write initial oid 17 2026-02-20T11:36:08.356 INFO:tasks.rados.rados.0.trial046.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2026-02-20T11:36:08.358 INFO:tasks.rados.rados.0.trial046.stdout:17: writing trial04641590-17 from 668912 to 1305602 tid 1 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:17: writing trial04641590-17 from 1903006 to 2268912 tid 2 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:1: finishing write tid 4 to trial04641590-1 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:1: oid 1 updating version 0 to 3 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:1: oid 1 version 3 is already newer than 3 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:1: oid 1 version 3 is already newer than 1 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:3: finishing write tid 2 to trial04641590-3 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:3: finishing write tid 3 to trial04641590-3 2026-02-20T11:36:08.363 INFO:tasks.rados.rados.0.trial046.stdout:4: finishing write tid 1 to trial04641590-4 2026-02-20T11:36:08.364 INFO:tasks.rados.rados.0.trial046.stdout:1: done (15 left) 2026-02-20T11:36:08.364 INFO:tasks.rados.rados.0.trial046.stdout:18: write initial oid 18 2026-02-20T11:36:08.364 INFO:tasks.rados.rados.0.trial046.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2026-02-20T11:36:08.368 INFO:tasks.rados.rados.0.trial046.stdout:18: writing trial04641590-18 from 685719 to 1397658 tid 1 2026-02-20T11:36:08.371 INFO:tasks.rados.rados.0.trial046.stdout:18: writing trial04641590-18 from 1845135 to 2285719 tid 2 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:5: finishing write tid 1 to trial04641590-5 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:3: finishing write tid 4 to trial04641590-3 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:3: oid 3 updating version 0 to 1 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:3: oid 3 updating version 1 to 3 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:3: oid 3 version 3 is already newer than 3 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:7: finishing write tid 1 to trial04641590-7 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:3: done (15 left) 2026-02-20T11:36:08.372 INFO:tasks.rados.rados.0.trial046.stdout:19: write initial oid 19 2026-02-20T11:36:08.373 INFO:tasks.rados.rados.0.trial046.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2026-02-20T11:36:08.377 INFO:tasks.rados.rados.0.trial046.stdout:19: writing trial04641590-19 from 702526 to 1489714 tid 1 2026-02-20T11:36:08.381 INFO:tasks.rados.rados.0.trial046.stdout:19: writing trial04641590-19 from 1903617 to 2302526 tid 2 2026-02-20T11:36:08.381 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.381 INFO:tasks.rados.rados.0.trial046.stdout:5: finishing write tid 2 to trial04641590-5 2026-02-20T11:36:08.381 INFO:tasks.rados.rados.0.trial046.stdout:7: finishing write tid 2 to trial04641590-7 2026-02-20T11:36:08.381 INFO:tasks.rados.rados.0.trial046.stdout:7: finishing write tid 3 to trial04641590-7 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:7: finishing write tid 4 to trial04641590-7 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:7: oid 7 updating version 0 to 3 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:7: oid 7 version 3 is already newer than 3 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:7: oid 7 version 3 is already newer than 1 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 7 v 3 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:5: finishing write tid 3 to trial04641590-5 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:5: finishing write tid 4 to trial04641590-5 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:5: oid 5 updating version 0 to 1 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:5: oid 5 updating version 1 to 3 2026-02-20T11:36:08.382 INFO:tasks.rados.rados.0.trial046.stdout:5: oid 5 version 3 is already newer than 3 2026-02-20T11:36:08.383 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 5 v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2026-02-20T11:36:08.383 INFO:tasks.rados.rados.0.trial046.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2026-02-20T11:36:08.383 INFO:tasks.rados.rados.0.trial046.stdout:11: finishing write tid 1 to trial04641590-11 2026-02-20T11:36:08.383 INFO:tasks.rados.rados.0.trial046.stdout:5: done (15 left) 2026-02-20T11:36:08.383 INFO:tasks.rados.rados.0.trial046.stdout:7: done (14 left) 2026-02-20T11:36:08.383 INFO:tasks.rados.rados.0.trial046.stdout:20: write initial oid 20 2026-02-20T11:36:08.383 INFO:tasks.rados.rados.0.trial046.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2026-02-20T11:36:08.385 INFO:tasks.rados.rados.0.trial046.stdout:20: writing trial04641590-20 from 719333 to 1181770 tid 1 2026-02-20T11:36:08.390 INFO:tasks.rados.rados.0.trial046.stdout:20: writing trial04641590-20 from 1962099 to 2319333 tid 2 2026-02-20T11:36:08.390 INFO:tasks.rados.rados.0.trial046.stdout:21: write initial oid 21 2026-02-20T11:36:08.390 INFO:tasks.rados.rados.0.trial046.stdout:8: finishing write tid 1 to trial04641590-8 2026-02-20T11:36:08.390 INFO:tasks.rados.rados.0.trial046.stdout:12: finishing write tid 1 to trial04641590-12 2026-02-20T11:36:08.390 INFO:tasks.rados.rados.0.trial046.stdout:4: finishing write tid 2 to trial04641590-4 2026-02-20T11:36:08.390 INFO:tasks.rados.rados.0.trial046.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2026-02-20T11:36:08.394 INFO:tasks.rados.rados.0.trial046.stdout:21: writing trial04641590-21 from 736140 to 1273826 tid 1 2026-02-20T11:36:08.399 INFO:tasks.rados.rados.0.trial046.stdout:21: writing trial04641590-21 from 2020581 to 2336140 tid 2 2026-02-20T11:36:08.399 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.399 INFO:tasks.rados.rados.0.trial046.stdout:11: finishing write tid 2 to trial04641590-11 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:4: finishing write tid 3 to trial04641590-4 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:12: finishing write tid 2 to trial04641590-12 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:4: finishing write tid 4 to trial04641590-4 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:4: oid 4 updating version 0 to 3 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:4: oid 4 version 3 is already newer than 3 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:4: oid 4 version 3 is already newer than 1 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 4 v 3 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:11: finishing write tid 3 to trial04641590-11 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:11: finishing write tid 4 to trial04641590-11 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:11: oid 11 updating version 0 to 6 2026-02-20T11:36:08.400 INFO:tasks.rados.rados.0.trial046.stdout:11: oid 11 version 6 is already newer than 4 2026-02-20T11:36:08.401 INFO:tasks.rados.rados.0.trial046.stdout:11: oid 11 version 6 is already newer than 6 2026-02-20T11:36:08.401 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 11 v 6 (ObjNum 10 snap 0 seq_num 10) dirty exists 2026-02-20T11:36:08.401 INFO:tasks.rados.rados.0.trial046.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2026-02-20T11:36:08.401 INFO:tasks.rados.rados.0.trial046.stdout:12: finishing write tid 3 to trial04641590-12 2026-02-20T11:36:08.401 INFO:tasks.rados.rados.0.trial046.stdout:4: done (15 left) 2026-02-20T11:36:08.401 INFO:tasks.rados.rados.0.trial046.stdout:11: done (14 left) 2026-02-20T11:36:08.401 INFO:tasks.rados.rados.0.trial046.stdout:22: write initial oid 22 2026-02-20T11:36:08.401 INFO:tasks.rados.rados.0.trial046.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2026-02-20T11:36:08.404 INFO:tasks.rados.rados.0.trial046.stdout:22: writing trial04641590-22 from 752947 to 1365882 tid 1 2026-02-20T11:36:08.408 INFO:tasks.rados.rados.0.trial046.stdout:22: writing trial04641590-22 from 1962710 to 2352947 tid 2 2026-02-20T11:36:08.408 INFO:tasks.rados.rados.0.trial046.stdout:23: write initial oid 23 2026-02-20T11:36:08.408 INFO:tasks.rados.rados.0.trial046.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2026-02-20T11:36:08.413 INFO:tasks.rados.rados.0.trial046.stdout:23: writing trial04641590-23 from 769754 to 1457938 tid 1 2026-02-20T11:36:08.417 INFO:tasks.rados.rados.0.trial046.stdout:23: writing trial04641590-23 from 2021192 to 2369754 tid 2 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout:12: finishing write tid 4 to trial04641590-12 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout:12: oid 12 updating version 0 to 1 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout:12: oid 12 updating version 1 to 3 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout:12: oid 12 version 3 is already newer than 3 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 12 v 3 (ObjNum 11 snap 0 seq_num 11) dirty exists 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout:8: finishing write tid 2 to trial04641590-8 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout:16: finishing write tid 1 to trial04641590-16 2026-02-20T11:36:08.418 INFO:tasks.rados.rados.0.trial046.stdout:8: finishing write tid 3 to trial04641590-8 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:8: finishing write tid 4 to trial04641590-8 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:8: oid 8 updating version 0 to 6 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:8: oid 8 version 6 is already newer than 4 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:8: oid 8 version 6 is already newer than 6 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 8 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:17: finishing write tid 1 to trial04641590-17 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:8: done (15 left) 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:12: done (14 left) 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:24: write initial oid 24 2026-02-20T11:36:08.419 INFO:tasks.rados.rados.0.trial046.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2026-02-20T11:36:08.422 INFO:tasks.rados.rados.0.trial046.stdout:24: writing trial04641590-24 from 786561 to 1266347 tid 1 2026-02-20T11:36:08.426 INFO:tasks.rados.rados.0.trial046.stdout:24: writing trial04641590-24 from 1796027 to 2263691 tid 2 2026-02-20T11:36:08.426 INFO:tasks.rados.rados.0.trial046.stdout:25: write initial oid 25 2026-02-20T11:36:08.426 INFO:tasks.rados.rados.0.trial046.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2026-02-20T11:36:08.429 INFO:tasks.rados.rados.0.trial046.stdout:25: writing trial04641590-25 from 403368 to 958403 tid 1 2026-02-20T11:36:08.435 INFO:tasks.rados.rados.0.trial046.stdout:25: writing trial04641590-25 from 1454509 to 2182184 tid 2 2026-02-20T11:36:08.435 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.435 INFO:tasks.rados.rados.0.trial046.stdout:16: finishing write tid 2 to trial04641590-16 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:16: finishing write tid 3 to trial04641590-16 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:6: finishing write tid 1 to trial04641590-6 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:16: finishing write tid 4 to trial04641590-16 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:16: oid 16 updating version 0 to 1 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:16: oid 16 updating version 1 to 3 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:16: oid 16 version 3 is already newer than 3 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 16 v 3 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:19: finishing write tid 1 to trial04641590-19 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:16: done (15 left) 2026-02-20T11:36:08.436 INFO:tasks.rados.rados.0.trial046.stdout:26: write initial oid 26 2026-02-20T11:36:08.437 INFO:tasks.rados.rados.0.trial046.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2026-02-20T11:36:08.438 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:08.439 INFO:tasks.rados.rados.0.trial046.stdout:26: writing trial04641590-26 from 420175 to 1050459 tid 1 2026-02-20T11:36:08.444 INFO:tasks.rados.rados.0.trial046.stdout:26: writing trial04641590-26 from 1796638 to 2267971 tid 2 2026-02-20T11:36:08.444 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.444 INFO:tasks.rados.rados.0.trial046.stdout:17: finishing write tid 2 to trial04641590-17 2026-02-20T11:36:08.444 INFO:tasks.rados.rados.0.trial046.stdout:17: finishing write tid 3 to trial04641590-17 2026-02-20T11:36:08.444 INFO:tasks.rados.rados.0.trial046.stdout:17: finishing write tid 4 to trial04641590-17 2026-02-20T11:36:08.444 INFO:tasks.rados.rados.0.trial046.stdout:17: oid 17 updating version 0 to 6 2026-02-20T11:36:08.444 INFO:tasks.rados.rados.0.trial046.stdout:17: oid 17 version 6 is already newer than 4 2026-02-20T11:36:08.444 INFO:tasks.rados.rados.0.trial046.stdout:17: oid 17 version 6 is already newer than 6 2026-02-20T11:36:08.444 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 17 v 6 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-20T11:36:08.445 INFO:tasks.rados.rados.0.trial046.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2026-02-20T11:36:08.445 INFO:tasks.rados.rados.0.trial046.stdout:9: finishing write tid 1 to trial04641590-9 2026-02-20T11:36:08.445 INFO:tasks.rados.rados.0.trial046.stdout:17: done (15 left) 2026-02-20T11:36:08.445 INFO:tasks.rados.rados.0.trial046.stdout:27: write initial oid 27 2026-02-20T11:36:08.445 INFO:tasks.rados.rados.0.trial046.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2026-02-20T11:36:08.448 INFO:tasks.rados.rados.0.trial046.stdout:27: writing trial04641590-27 from 436982 to 1142515 tid 1 2026-02-20T11:36:08.453 INFO:tasks.rados.rados.0.trial046.stdout:27: writing trial04641590-27 from 1855120 to 2436982 tid 2 2026-02-20T11:36:08.453 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.453 INFO:tasks.rados.rados.0.trial046.stdout:19: finishing write tid 2 to trial04641590-19 2026-02-20T11:36:08.453 INFO:tasks.rados.rados.0.trial046.stdout:19: finishing write tid 3 to trial04641590-19 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:19: finishing write tid 4 to trial04641590-19 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:19: oid 19 updating version 0 to 9 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:19: oid 19 version 9 is already newer than 7 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:19: oid 19 version 9 is already newer than 9 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 19 v 9 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:23: finishing write tid 1 to trial04641590-23 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:19: done (15 left) 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:28: write initial oid 28 2026-02-20T11:36:08.454 INFO:tasks.rados.rados.0.trial046.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2026-02-20T11:36:08.458 INFO:tasks.rados.rados.0.trial046.stdout:28: writing trial04641590-28 from 453789 to 1234571 tid 1 2026-02-20T11:36:08.462 INFO:tasks.rados.rados.0.trial046.stdout:28: writing trial04641590-28 from 1913602 to 2388604 tid 2 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:6: finishing write tid 2 to trial04641590-6 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:6: finishing write tid 3 to trial04641590-6 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:6: finishing write tid 4 to trial04641590-6 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:6: oid 6 updating version 0 to 6 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:6: oid 6 version 6 is already newer than 6 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:6: oid 6 version 6 is already newer than 4 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 6 v 6 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:23: finishing write tid 2 to trial04641590-23 2026-02-20T11:36:08.463 INFO:tasks.rados.rados.0.trial046.stdout:23: finishing write tid 3 to trial04641590-23 2026-02-20T11:36:08.464 INFO:tasks.rados.rados.0.trial046.stdout:6: done (15 left) 2026-02-20T11:36:08.464 INFO:tasks.rados.rados.0.trial046.stdout:29: write initial oid 29 2026-02-20T11:36:08.464 INFO:tasks.rados.rados.0.trial046.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2026-02-20T11:36:08.466 INFO:tasks.rados.rados.0.trial046.stdout:29: writing trial04641590-29 from 470596 to 926627 tid 1 2026-02-20T11:36:08.471 INFO:tasks.rados.rados.0.trial046.stdout:29: writing trial04641590-29 from 1572084 to 2190744 tid 2 2026-02-20T11:36:08.471 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.471 INFO:tasks.rados.rados.0.trial046.stdout:24: finishing write tid 1 to trial04641590-24 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:23: finishing write tid 4 to trial04641590-23 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:23: oid 23 updating version 0 to 6 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:23: oid 23 version 6 is already newer than 6 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:23: oid 23 version 6 is already newer than 4 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:9: finishing write tid 2 to trial04641590-9 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:26: finishing write tid 1 to trial04641590-26 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:25: finishing write tid 1 to trial04641590-25 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:9: finishing write tid 3 to trial04641590-9 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:9: finishing write tid 4 to trial04641590-9 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:9: oid 9 updating version 0 to 7 2026-02-20T11:36:08.472 INFO:tasks.rados.rados.0.trial046.stdout:9: oid 9 updating version 7 to 9 2026-02-20T11:36:08.473 INFO:tasks.rados.rados.0.trial046.stdout:9: oid 9 version 9 is already newer than 9 2026-02-20T11:36:08.473 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 9 v 9 (ObjNum 8 snap 0 seq_num 8) dirty exists 2026-02-20T11:36:08.473 INFO:tasks.rados.rados.0.trial046.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2026-02-20T11:36:08.473 INFO:tasks.rados.rados.0.trial046.stdout:9: done (15 left) 2026-02-20T11:36:08.473 INFO:tasks.rados.rados.0.trial046.stdout:23: done (14 left) 2026-02-20T11:36:08.473 INFO:tasks.rados.rados.0.trial046.stdout:30: write initial oid 30 2026-02-20T11:36:08.473 INFO:tasks.rados.rados.0.trial046.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2026-02-20T11:36:08.475 INFO:tasks.rados.rados.0.trial046.stdout:30: writing trial04641590-30 from 487403 to 1018683 tid 1 2026-02-20T11:36:08.479 INFO:tasks.rados.rados.0.trial046.stdout:30: writing trial04641590-30 from 1514213 to 1992884 tid 2 2026-02-20T11:36:08.479 INFO:tasks.rados.rados.0.trial046.stdout:31: write initial oid 31 2026-02-20T11:36:08.479 INFO:tasks.rados.rados.0.trial046.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2026-02-20T11:36:08.483 INFO:tasks.rados.rados.0.trial046.stdout:31: writing trial04641590-31 from 504210 to 1110739 tid 1 2026-02-20T11:36:08.487 INFO:tasks.rados.rados.0.trial046.stdout:31: writing trial04641590-31 from 1572695 to 2195024 tid 2 2026-02-20T11:36:08.487 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.487 INFO:tasks.rados.rados.0.trial046.stdout:10: finishing write tid 1 to trial04641590-10 2026-02-20T11:36:08.487 INFO:tasks.rados.rados.0.trial046.stdout:24: finishing write tid 2 to trial04641590-24 2026-02-20T11:36:08.487 INFO:tasks.rados.rados.0.trial046.stdout:26: finishing write tid 2 to trial04641590-26 2026-02-20T11:36:08.490 INFO:tasks.rados.rados.0.trial046.stdout:26: finishing write tid 3 to trial04641590-26 2026-02-20T11:36:08.492 INFO:tasks.rados.rados.0.trial046.stdout:26: finishing write tid 4 to trial04641590-26 2026-02-20T11:36:08.492 INFO:tasks.rados.rados.0.trial046.stdout:26: oid 26 updating version 0 to 1 2026-02-20T11:36:08.492 INFO:tasks.rados.rados.0.trial046.stdout:26: oid 26 updating version 1 to 3 2026-02-20T11:36:08.492 INFO:tasks.rados.rados.0.trial046.stdout:26: oid 26 version 3 is already newer than 3 2026-02-20T11:36:08.492 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 26 v 3 (ObjNum 25 snap 0 seq_num 25) dirty exists 2026-02-20T11:36:08.492 INFO:tasks.rados.rados.0.trial046.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2026-02-20T11:36:08.492 INFO:tasks.rados.rados.0.trial046.stdout:26: done (15 left) 2026-02-20T11:36:08.493 INFO:tasks.rados.rados.0.trial046.stdout:32: write initial oid 32 2026-02-20T11:36:08.493 INFO:tasks.rados.rados.0.trial046.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2026-02-20T11:36:08.497 INFO:tasks.rados.rados.0.trial046.stdout:32: writing trial04641590-32 from 521017 to 1319148 tid 1 2026-02-20T11:36:08.501 INFO:tasks.rados.rados.0.trial046.stdout:32: writing trial04641590-32 from 1747530 to 2229870 tid 2 2026-02-20T11:36:08.501 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.501 INFO:tasks.rados.rados.0.trial046.stdout:29: finishing write tid 1 to trial04641590-29 2026-02-20T11:36:08.501 INFO:tasks.rados.rados.0.trial046.stdout:25: finishing write tid 2 to trial04641590-25 2026-02-20T11:36:08.501 INFO:tasks.rados.rados.0.trial046.stdout:13: finishing write tid 1 to trial04641590-13 2026-02-20T11:36:08.501 INFO:tasks.rados.rados.0.trial046.stdout:30: finishing write tid 1 to trial04641590-30 2026-02-20T11:36:08.508 INFO:tasks.rados.rados.0.trial046.stdout:25: finishing write tid 3 to trial04641590-25 2026-02-20T11:36:08.513 INFO:tasks.rados.rados.0.trial046.stdout:25: finishing write tid 4 to trial04641590-25 2026-02-20T11:36:08.513 INFO:tasks.rados.rados.0.trial046.stdout:25: oid 25 updating version 0 to 12 2026-02-20T11:36:08.513 INFO:tasks.rados.rados.0.trial046.stdout:25: oid 25 version 12 is already newer than 10 2026-02-20T11:36:08.514 INFO:tasks.rados.rados.0.trial046.stdout:25: oid 25 version 12 is already newer than 12 2026-02-20T11:36:08.514 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 25 v 12 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-20T11:36:08.514 INFO:tasks.rados.rados.0.trial046.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2026-02-20T11:36:08.514 INFO:tasks.rados.rados.0.trial046.stdout:25: done (15 left) 2026-02-20T11:36:08.514 INFO:tasks.rados.rados.0.trial046.stdout:33: write initial oid 33 2026-02-20T11:36:08.514 INFO:tasks.rados.rados.0.trial046.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2026-02-20T11:36:08.517 INFO:tasks.rados.rados.0.trial046.stdout:33: writing trial04641590-33 from 537824 to 1011204 tid 1 2026-02-20T11:36:08.523 INFO:tasks.rados.rados.0.trial046.stdout:33: writing trial04641590-33 from 1806012 to 2432010 tid 2 2026-02-20T11:36:08.523 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:29: finishing write tid 2 to trial04641590-29 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:10: finishing write tid 2 to trial04641590-10 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:30: finishing write tid 2 to trial04641590-30 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:29: finishing write tid 3 to trial04641590-29 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:29: finishing write tid 4 to trial04641590-29 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:29: oid 29 updating version 0 to 6 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:29: oid 29 version 6 is already newer than 4 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:29: oid 29 version 6 is already newer than 6 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 29 v 6 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2026-02-20T11:36:08.524 INFO:tasks.rados.rados.0.trial046.stdout:24: finishing write tid 3 to trial04641590-24 2026-02-20T11:36:08.525 INFO:tasks.rados.rados.0.trial046.stdout:29: done (15 left) 2026-02-20T11:36:08.525 INFO:tasks.rados.rados.0.trial046.stdout:34: write initial oid 34 2026-02-20T11:36:08.525 INFO:tasks.rados.rados.0.trial046.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2026-02-20T11:36:08.525 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:08.521+0000 7fabf77b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:08.527 INFO:tasks.rados.rados.0.trial046.stdout:34: writing trial04641590-34 from 554631 to 1103260 tid 1 2026-02-20T11:36:08.527 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:08.525+0000 7fabf77b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:08.532 INFO:tasks.rados.rados.0.trial046.stdout:34: writing trial04641590-34 from 1748141 to 2234150 tid 2 2026-02-20T11:36:08.532 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.532 INFO:tasks.rados.rados.0.trial046.stdout:30: finishing write tid 3 to trial04641590-30 2026-02-20T11:36:08.532 INFO:tasks.rados.rados.0.trial046.stdout:32: finishing write tid 1 to trial04641590-32 2026-02-20T11:36:08.532 INFO:tasks.rados.rados.0.trial046.stdout:30: finishing write tid 4 to trial04641590-30 2026-02-20T11:36:08.533 INFO:tasks.rados.rados.0.trial046.stdout:30: oid 30 updating version 0 to 9 2026-02-20T11:36:08.533 INFO:tasks.rados.rados.0.trial046.stdout:30: oid 30 version 9 is already newer than 7 2026-02-20T11:36:08.533 INFO:tasks.rados.rados.0.trial046.stdout:30: oid 30 version 9 is already newer than 9 2026-02-20T11:36:08.533 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 30 v 9 (ObjNum 29 snap 0 seq_num 29) dirty exists 2026-02-20T11:36:08.533 INFO:tasks.rados.rados.0.trial046.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2026-02-20T11:36:08.533 INFO:tasks.rados.rados.0.trial046.stdout:30: done (15 left) 2026-02-20T11:36:08.533 INFO:tasks.rados.rados.0.trial046.stdout:35: write initial oid 35 2026-02-20T11:36:08.533 INFO:tasks.rados.rados.0.trial046.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2026-02-20T11:36:08.536 INFO:tasks.rados.rados.0.trial046.stdout:35: writing trial04641590-35 from 571438 to 1195316 tid 1 2026-02-20T11:36:08.542 INFO:tasks.rados.rados.0.trial046.stdout:35: writing trial04641590-35 from 1806623 to 2436290 tid 2 2026-02-20T11:36:08.542 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.542 INFO:tasks.rados.rados.0.trial046.stdout:24: finishing write tid 4 to trial04641590-24 2026-02-20T11:36:08.542 INFO:tasks.rados.rados.0.trial046.stdout:24: oid 24 updating version 0 to 1 2026-02-20T11:36:08.542 INFO:tasks.rados.rados.0.trial046.stdout:24: oid 24 updating version 1 to 3 2026-02-20T11:36:08.542 INFO:tasks.rados.rados.0.trial046.stdout:24: oid 24 version 3 is already newer than 3 2026-02-20T11:36:08.542 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 24 v 3 (ObjNum 23 snap 0 seq_num 23) dirty exists 2026-02-20T11:36:08.542 INFO:tasks.rados.rados.0.trial046.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2026-02-20T11:36:08.543 INFO:tasks.rados.rados.0.trial046.stdout:24: done (15 left) 2026-02-20T11:36:08.543 INFO:tasks.rados.rados.0.trial046.stdout:36: write initial oid 36 2026-02-20T11:36:08.543 INFO:tasks.rados.rados.0.trial046.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2026-02-20T11:36:08.546 INFO:tasks.rados.rados.0.trial046.stdout:36: writing trial04641590-36 from 588245 to 1287372 tid 1 2026-02-20T11:36:08.551 INFO:tasks.rados.rados.0.trial046.stdout:36: writing trial04641590-36 from 1865105 to 2354783 tid 2 2026-02-20T11:36:08.551 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.551 INFO:tasks.rados.rados.0.trial046.stdout:10: finishing write tid 3 to trial04641590-10 2026-02-20T11:36:08.551 INFO:tasks.rados.rados.0.trial046.stdout:10: finishing write tid 4 to trial04641590-10 2026-02-20T11:36:08.551 INFO:tasks.rados.rados.0.trial046.stdout:10: oid 10 updating version 0 to 12 2026-02-20T11:36:08.551 INFO:tasks.rados.rados.0.trial046.stdout:10: oid 10 version 12 is already newer than 10 2026-02-20T11:36:08.551 INFO:tasks.rados.rados.0.trial046.stdout:10: oid 10 version 12 is already newer than 12 2026-02-20T11:36:08.551 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 10 v 12 (ObjNum 9 snap 0 seq_num 9) dirty exists 2026-02-20T11:36:08.552 INFO:tasks.rados.rados.0.trial046.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2026-02-20T11:36:08.552 INFO:tasks.rados.rados.0.trial046.stdout:10: done (15 left) 2026-02-20T11:36:08.552 INFO:tasks.rados.rados.0.trial046.stdout:37: write initial oid 37 2026-02-20T11:36:08.552 INFO:tasks.rados.rados.0.trial046.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2026-02-20T11:36:08.556 INFO:tasks.rados.rados.0.trial046.stdout:37: writing trial04641590-37 from 605052 to 1379428 tid 1 2026-02-20T11:36:08.561 INFO:tasks.rados.rados.0.trial046.stdout:37: writing trial04641590-37 from 1923587 to 2556923 tid 2 2026-02-20T11:36:08.561 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.561 INFO:tasks.rados.rados.0.trial046.stdout:33: finishing write tid 1 to trial04641590-33 2026-02-20T11:36:08.561 INFO:tasks.rados.rados.0.trial046.stdout:31: finishing write tid 1 to trial04641590-31 2026-02-20T11:36:08.561 INFO:tasks.rados.rados.0.trial046.stdout:34: finishing write tid 1 to trial04641590-34 2026-02-20T11:36:08.561 INFO:tasks.rados.rados.0.trial046.stdout:14: finishing write tid 1 to trial04641590-14 2026-02-20T11:36:08.561 INFO:tasks.rados.rados.0.trial046.stdout:32: finishing write tid 2 to trial04641590-32 2026-02-20T11:36:08.561 INFO:tasks.rados.rados.0.trial046.stdout:32: finishing write tid 3 to trial04641590-32 2026-02-20T11:36:08.561 INFO:tasks.rados.rados.0.trial046.stdout:32: finishing write tid 4 to trial04641590-32 2026-02-20T11:36:08.562 INFO:tasks.rados.rados.0.trial046.stdout:32: oid 32 updating version 0 to 9 2026-02-20T11:36:08.562 INFO:tasks.rados.rados.0.trial046.stdout:32: oid 32 version 9 is already newer than 7 2026-02-20T11:36:08.562 INFO:tasks.rados.rados.0.trial046.stdout:32: oid 32 version 9 is already newer than 9 2026-02-20T11:36:08.562 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 32 v 9 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-20T11:36:08.562 INFO:tasks.rados.rados.0.trial046.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2026-02-20T11:36:08.562 INFO:tasks.rados.rados.0.trial046.stdout:32: done (15 left) 2026-02-20T11:36:08.562 INFO:tasks.rados.rados.0.trial046.stdout:38: write initial oid 38 2026-02-20T11:36:08.562 INFO:tasks.rados.rados.0.trial046.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2026-02-20T11:36:08.564 INFO:tasks.rados.rados.0.trial046.stdout:38: writing trial04641590-38 from 621859 to 1071484 tid 1 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout:38: writing trial04641590-38 from 1865716 to 2621859 tid 2 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout:31: finishing write tid 2 to trial04641590-31 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout:33: finishing write tid 2 to trial04641590-33 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout:31: finishing write tid 3 to trial04641590-31 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout:34: finishing write tid 2 to trial04641590-34 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout:31: finishing write tid 4 to trial04641590-31 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout:31: oid 31 updating version 0 to 1 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout:31: oid 31 updating version 1 to 3 2026-02-20T11:36:08.571 INFO:tasks.rados.rados.0.trial046.stdout:31: oid 31 version 3 is already newer than 3 2026-02-20T11:36:08.572 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 31 v 3 (ObjNum 30 snap 0 seq_num 30) dirty exists 2026-02-20T11:36:08.572 INFO:tasks.rados.rados.0.trial046.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2026-02-20T11:36:08.572 INFO:tasks.rados.rados.0.trial046.stdout:34: finishing write tid 3 to trial04641590-34 2026-02-20T11:36:08.572 INFO:tasks.rados.rados.0.trial046.stdout:31: done (15 left) 2026-02-20T11:36:08.572 INFO:tasks.rados.rados.0.trial046.stdout:39: write initial oid 39 2026-02-20T11:36:08.572 INFO:tasks.rados.rados.0.trial046.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2026-02-20T11:36:08.574 INFO:tasks.rados.rados.0.trial046.stdout:39: writing trial04641590-39 from 638666 to 1163540 tid 1 2026-02-20T11:36:08.580 INFO:tasks.rados.rados.0.trial046.stdout:39: writing trial04641590-39 from 1924198 to 2561203 tid 2 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:13: finishing write tid 2 to trial04641590-13 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:34: finishing write tid 4 to trial04641590-34 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:34: oid 34 updating version 0 to 4 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:34: oid 34 updating version 4 to 6 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:34: oid 34 version 6 is already newer than 6 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 34 v 6 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:36: finishing write tid 1 to trial04641590-36 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:13: finishing write tid 3 to trial04641590-13 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:33: finishing write tid 3 to trial04641590-33 2026-02-20T11:36:08.581 INFO:tasks.rados.rados.0.trial046.stdout:34: done (15 left) 2026-02-20T11:36:08.582 INFO:tasks.rados.rados.0.trial046.stdout:40: write initial oid 40 2026-02-20T11:36:08.582 INFO:tasks.rados.rados.0.trial046.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2026-02-20T11:36:08.585 INFO:tasks.rados.rados.0.trial046.stdout:40: writing trial04641590-40 from 655473 to 1371949 tid 1 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:40: writing trial04641590-40 from 2099033 to 2655473 tid 2 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:13: finishing write tid 4 to trial04641590-13 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:13: oid 13 updating version 0 to 1 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:13: oid 13 updating version 1 to 3 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:13: oid 13 version 3 is already newer than 3 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 13 v 3 (ObjNum 12 snap 0 seq_num 12) dirty exists 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:13: done (15 left) 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:41: write initial oid 41 2026-02-20T11:36:08.590 INFO:tasks.rados.rados.0.trial046.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2026-02-20T11:36:08.596 INFO:tasks.rados.rados.0.trial046.stdout:41: writing trial04641590-41 from 672280 to 1464005 tid 1 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:41: writing trial04641590-41 from 2157515 to 2672280 tid 2 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:33: finishing write tid 4 to trial04641590-33 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:33: oid 33 updating version 0 to 15 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:33: oid 33 version 15 is already newer than 15 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:33: oid 33 version 15 is already newer than 13 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 33 v 15 (ObjNum 32 snap 0 seq_num 32) dirty exists 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:14: finishing write tid 2 to trial04641590-14 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:38: finishing write tid 1 to trial04641590-38 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:33: done (15 left) 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:42: write initial oid 42 2026-02-20T11:36:08.601 INFO:tasks.rados.rados.0.trial046.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2026-02-20T11:36:08.605 INFO:tasks.rados.rados.0.trial046.stdout:42: writing trial04641590-42 from 689087 to 1156061 tid 1 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:42: writing trial04641590-42 from 1699644 to 2483976 tid 2 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:36: finishing write tid 2 to trial04641590-36 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:35: finishing write tid 1 to trial04641590-35 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:14: finishing write tid 3 to trial04641590-14 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:36: finishing write tid 3 to trial04641590-36 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:14: finishing write tid 4 to trial04641590-14 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:14: oid 14 updating version 0 to 15 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:14: oid 14 version 15 is already newer than 15 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:14: oid 14 version 15 is already newer than 13 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 14 v 15 (ObjNum 13 snap 0 seq_num 13) dirty exists 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:36: finishing write tid 4 to trial04641590-36 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:36: oid 36 updating version 0 to 1 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:36: oid 36 updating version 1 to 3 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:36: oid 36 version 3 is already newer than 3 2026-02-20T11:36:08.611 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 36 v 3 (ObjNum 35 snap 0 seq_num 35) dirty exists 2026-02-20T11:36:08.612 INFO:tasks.rados.rados.0.trial046.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2026-02-20T11:36:08.612 INFO:tasks.rados.rados.0.trial046.stdout:14: done (15 left) 2026-02-20T11:36:08.612 INFO:tasks.rados.rados.0.trial046.stdout:36: done (14 left) 2026-02-20T11:36:08.612 INFO:tasks.rados.rados.0.trial046.stdout:43: write initial oid 43 2026-02-20T11:36:08.612 INFO:tasks.rados.rados.0.trial046.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2026-02-20T11:36:08.615 INFO:tasks.rados.rados.0.trial046.stdout:43: writing trial04641590-43 from 705894 to 1248117 tid 1 2026-02-20T11:36:08.620 INFO:tasks.rados.rados.0.trial046.stdout:43: writing trial04641590-43 from 1758126 to 2402469 tid 2 2026-02-20T11:36:08.620 INFO:tasks.rados.rados.0.trial046.stdout:44: write initial oid 44 2026-02-20T11:36:08.620 INFO:tasks.rados.rados.0.trial046.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2026-02-20T11:36:08.625 INFO:tasks.rados.rados.0.trial046.stdout:44: writing trial04641590-44 from 722701 to 1340173 tid 1 2026-02-20T11:36:08.630 INFO:tasks.rados.rados.0.trial046.stdout:44: writing trial04641590-44 from 1816608 to 2604609 tid 2 2026-02-20T11:36:08.630 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.630 INFO:tasks.rados.rados.0.trial046.stdout:15: finishing write tid 1 to trial04641590-15 2026-02-20T11:36:08.630 INFO:tasks.rados.rados.0.trial046.stdout:37: finishing write tid 1 to trial04641590-37 2026-02-20T11:36:08.630 INFO:tasks.rados.rados.0.trial046.stdout:42: finishing write tid 1 to trial04641590-42 2026-02-20T11:36:08.630 INFO:tasks.rados.rados.0.trial046.stdout:38: finishing write tid 2 to trial04641590-38 2026-02-20T11:36:08.632 INFO:tasks.rados.rados.0.trial046.stdout:38: finishing write tid 3 to trial04641590-38 2026-02-20T11:36:08.637 INFO:tasks.rados.rados.0.trial046.stdout:38: finishing write tid 4 to trial04641590-38 2026-02-20T11:36:08.637 INFO:tasks.rados.rados.0.trial046.stdout:38: oid 38 updating version 0 to 9 2026-02-20T11:36:08.637 INFO:tasks.rados.rados.0.trial046.stdout:38: oid 38 version 9 is already newer than 7 2026-02-20T11:36:08.637 INFO:tasks.rados.rados.0.trial046.stdout:38: oid 38 version 9 is already newer than 9 2026-02-20T11:36:08.637 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 38 v 9 (ObjNum 37 snap 0 seq_num 37) dirty exists 2026-02-20T11:36:08.637 INFO:tasks.rados.rados.0.trial046.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2026-02-20T11:36:08.637 INFO:tasks.rados.rados.0.trial046.stdout:38: done (15 left) 2026-02-20T11:36:08.637 INFO:tasks.rados.rados.0.trial046.stdout:45: write initial oid 45 2026-02-20T11:36:08.637 INFO:tasks.rados.rados.0.trial046.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2026-02-20T11:36:08.642 INFO:tasks.rados.rados.0.trial046.stdout:45: writing trial04641590-45 from 739508 to 1432229 tid 1 2026-02-20T11:36:08.646 INFO:tasks.rados.rados.0.trial046.stdout:45: writing trial04641590-45 from 1875090 to 2523102 tid 2 2026-02-20T11:36:08.646 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.646 INFO:tasks.rados.rados.0.trial046.stdout:18: finishing write tid 1 to trial04641590-18 2026-02-20T11:36:08.647 INFO:tasks.rados.rados.0.trial046.stdout:35: finishing write tid 2 to trial04641590-35 2026-02-20T11:36:08.649 INFO:tasks.rados.rados.0.trial046.stdout:43: finishing write tid 1 to trial04641590-43 2026-02-20T11:36:08.656 INFO:tasks.rados.rados.0.trial046.stdout:44: finishing write tid 1 to trial04641590-44 2026-02-20T11:36:08.658 INFO:tasks.rados.rados.0.trial046.stdout:15: finishing write tid 2 to trial04641590-15 2026-02-20T11:36:08.661 INFO:tasks.rados.rados.0.trial046.stdout:42: finishing write tid 2 to trial04641590-42 2026-02-20T11:36:08.662 INFO:tasks.rados.rados.0.trial046.stdout:43: finishing write tid 2 to trial04641590-43 2026-02-20T11:36:08.664 INFO:tasks.rados.rados.0.trial046.stdout:37: finishing write tid 2 to trial04641590-37 2026-02-20T11:36:08.670 INFO:tasks.rados.rados.0.trial046.stdout:43: finishing write tid 3 to trial04641590-43 2026-02-20T11:36:08.670 INFO:tasks.rados.rados.0.trial046.stdout:42: finishing write tid 3 to trial04641590-42 2026-02-20T11:36:08.670 INFO:tasks.rados.rados.0.trial046.stdout:15: finishing write tid 3 to trial04641590-15 2026-02-20T11:36:08.671 INFO:tasks.rados.rados.0.trial046.stdout:43: finishing write tid 4 to trial04641590-43 2026-02-20T11:36:08.671 INFO:tasks.rados.rados.0.trial046.stdout:43: oid 43 updating version 0 to 6 2026-02-20T11:36:08.672 INFO:tasks.rados.rados.0.trial046.stdout:43: oid 43 version 6 is already newer than 6 2026-02-20T11:36:08.672 INFO:tasks.rados.rados.0.trial046.stdout:43: oid 43 version 6 is already newer than 4 2026-02-20T11:36:08.672 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 43 v 6 (ObjNum 42 snap 0 seq_num 42) dirty exists 2026-02-20T11:36:08.672 INFO:tasks.rados.rados.0.trial046.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2026-02-20T11:36:08.672 INFO:tasks.rados.rados.0.trial046.stdout:43: done (15 left) 2026-02-20T11:36:08.672 INFO:tasks.rados.rados.0.trial046.stdout:46: write initial oid 46 2026-02-20T11:36:08.672 INFO:tasks.rados.rados.0.trial046.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2026-02-20T11:36:08.677 INFO:tasks.rados.rados.0.trial046.stdout:46: writing trial04641590-46 from 756315 to 1524285 tid 1 2026-02-20T11:36:08.682 INFO:tasks.rados.rados.0.trial046.stdout:46: writing trial04641590-46 from 1933572 to 2725242 tid 2 2026-02-20T11:36:08.682 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.682 INFO:tasks.rados.rados.0.trial046.stdout:42: finishing write tid 4 to trial04641590-42 2026-02-20T11:36:08.682 INFO:tasks.rados.rados.0.trial046.stdout:42: oid 42 updating version 0 to 12 2026-02-20T11:36:08.682 INFO:tasks.rados.rados.0.trial046.stdout:42: oid 42 version 12 is already newer than 12 2026-02-20T11:36:08.682 INFO:tasks.rados.rados.0.trial046.stdout:42: oid 42 version 12 is already newer than 10 2026-02-20T11:36:08.682 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 42 v 12 (ObjNum 41 snap 0 seq_num 41) dirty exists 2026-02-20T11:36:08.682 INFO:tasks.rados.rados.0.trial046.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2026-02-20T11:36:08.682 INFO:tasks.rados.rados.0.trial046.stdout:37: finishing write tid 3 to trial04641590-37 2026-02-20T11:36:08.683 INFO:tasks.rados.rados.0.trial046.stdout:42: done (15 left) 2026-02-20T11:36:08.683 INFO:tasks.rados.rados.0.trial046.stdout:47: write initial oid 47 2026-02-20T11:36:08.683 INFO:tasks.rados.rados.0.trial046.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2026-02-20T11:36:08.687 INFO:tasks.rados.rados.0.trial046.stdout:47: writing trial04641590-47 from 773122 to 1332694 tid 1 2026-02-20T11:36:08.693 INFO:tasks.rados.rados.0.trial046.stdout:47: writing trial04641590-47 from 1992054 to 2643735 tid 2 2026-02-20T11:36:08.693 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.693 INFO:tasks.rados.rados.0.trial046.stdout:37: finishing write tid 4 to trial04641590-37 2026-02-20T11:36:08.693 INFO:tasks.rados.rados.0.trial046.stdout:37: oid 37 updating version 0 to 16 2026-02-20T11:36:08.693 INFO:tasks.rados.rados.0.trial046.stdout:37: oid 37 updating version 16 to 18 2026-02-20T11:36:08.693 INFO:tasks.rados.rados.0.trial046.stdout:37: oid 37 version 18 is already newer than 18 2026-02-20T11:36:08.693 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 37 v 18 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-20T11:36:08.694 INFO:tasks.rados.rados.0.trial046.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2026-02-20T11:36:08.694 INFO:tasks.rados.rados.0.trial046.stdout:37: done (15 left) 2026-02-20T11:36:08.694 INFO:tasks.rados.rados.0.trial046.stdout:48: write initial oid 48 2026-02-20T11:36:08.694 INFO:tasks.rados.rados.0.trial046.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2026-02-20T11:36:08.697 INFO:tasks.rados.rados.0.trial046.stdout:48: writing trial04641590-48 from 789929 to 1424750 tid 1 2026-02-20T11:36:08.703 INFO:tasks.rados.rados.0.trial046.stdout:48: writing trial04641590-48 from 2050536 to 2789929 tid 2 2026-02-20T11:36:08.703 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.703 INFO:tasks.rados.rados.0.trial046.stdout:15: finishing write tid 4 to trial04641590-15 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:15: oid 15 updating version 0 to 6 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:15: oid 15 version 6 is already newer than 4 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:15: oid 15 version 6 is already newer than 6 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 15 v 6 (ObjNum 14 snap 0 seq_num 14) dirty exists 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:35: finishing write tid 3 to trial04641590-35 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:28: finishing write tid 1 to trial04641590-28 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:15: done (15 left) 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:49: write initial oid 49 2026-02-20T11:36:08.704 INFO:tasks.rados.rados.0.trial046.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2026-02-20T11:36:08.707 INFO:tasks.rados.rados.0.trial046.stdout:49: writing trial04641590-49 from 406736 to 1116806 tid 1 2026-02-20T11:36:08.712 INFO:tasks.rados.rados.0.trial046.stdout:49: writing trial04641590-49 from 1709018 to 2364368 tid 2 2026-02-20T11:36:08.712 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.712 INFO:tasks.rados.rados.0.trial046.stdout:35: finishing write tid 4 to trial04641590-35 2026-02-20T11:36:08.712 INFO:tasks.rados.rados.0.trial046.stdout:35: oid 35 updating version 0 to 6 2026-02-20T11:36:08.712 INFO:tasks.rados.rados.0.trial046.stdout:35: oid 35 version 6 is already newer than 4 2026-02-20T11:36:08.713 INFO:tasks.rados.rados.0.trial046.stdout:35: oid 35 version 6 is already newer than 6 2026-02-20T11:36:08.713 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2026-02-20T11:36:08.713 INFO:tasks.rados.rados.0.trial046.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2026-02-20T11:36:08.713 INFO:tasks.rados.rados.0.trial046.stdout:35: done (15 left) 2026-02-20T11:36:08.713 INFO:tasks.rados.rados.0.trial046.stdout:50: write initial oid 50 2026-02-20T11:36:08.713 INFO:tasks.rados.rados.0.trial046.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2026-02-20T11:36:08.716 INFO:tasks.rados.rados.0.trial046.stdout:50: writing trial04641590-50 from 423543 to 1208862 tid 1 2026-02-20T11:36:08.722 INFO:tasks.rados.rados.0.trial046.stdout:50: writing trial04641590-50 from 1767500 to 2566508 tid 2 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:27: finishing write tid 1 to trial04641590-27 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:44: finishing write tid 2 to trial04641590-44 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:44: finishing write tid 3 to trial04641590-44 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:44: finishing write tid 4 to trial04641590-44 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:44: oid 44 updating version 0 to 6 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:44: oid 44 version 6 is already newer than 4 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:44: oid 44 version 6 is already newer than 6 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 44 v 6 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:18: finishing write tid 2 to trial04641590-18 2026-02-20T11:36:08.723 INFO:tasks.rados.rados.0.trial046.stdout:44: done (15 left) 2026-02-20T11:36:08.724 INFO:tasks.rados.rados.0.trial046.stdout:51: write (excl) oid 23 current snap is 0 2026-02-20T11:36:08.724 INFO:tasks.rados.rados.0.trial046.stdout:51: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2026-02-20T11:36:08.725 INFO:tasks.rados.rados.0.trial046.stdout:51: writing trial04641590-23 from 440350 to 900918 tid 1 2026-02-20T11:36:08.729 INFO:tasks.rados.rados.0.trial046.stdout:51: writing trial04641590-23 from 1309629 to 1852295 tid 2 2026-02-20T11:36:08.734 INFO:tasks.rados.rados.0.trial046.stdout:51: writing trial04641590-23 from 2323973 to 2840350 tid 3 2026-02-20T11:36:08.734 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.734 INFO:tasks.rados.rados.0.trial046.stdout:18: finishing write tid 3 to trial04641590-18 2026-02-20T11:36:08.734 INFO:tasks.rados.rados.0.trial046.stdout:18: finishing write tid 4 to trial04641590-18 2026-02-20T11:36:08.734 INFO:tasks.rados.rados.0.trial046.stdout:18: oid 18 updating version 0 to 18 2026-02-20T11:36:08.734 INFO:tasks.rados.rados.0.trial046.stdout:18: oid 18 version 18 is already newer than 18 2026-02-20T11:36:08.734 INFO:tasks.rados.rados.0.trial046.stdout:18: oid 18 version 18 is already newer than 16 2026-02-20T11:36:08.734 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 18 v 18 (ObjNum 17 snap 0 seq_num 17) dirty exists 2026-02-20T11:36:08.734 INFO:tasks.rados.rados.0.trial046.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2026-02-20T11:36:08.735 INFO:tasks.rados.rados.0.trial046.stdout:18: done (15 left) 2026-02-20T11:36:08.735 INFO:tasks.rados.rados.0.trial046.stdout:52: write (excl) oid 14 current snap is 0 2026-02-20T11:36:08.735 INFO:tasks.rados.rados.0.trial046.stdout:52: seq_num 51 ranges {457157=535817,1768111=402677} 2026-02-20T11:36:08.737 INFO:tasks.rados.rados.0.trial046.stdout:52: writing trial04641590-14 from 457157 to 992974 tid 1 2026-02-20T11:36:08.742 INFO:tasks.rados.rados.0.trial046.stdout:52: writing trial04641590-14 from 1768111 to 2170788 tid 2 2026-02-20T11:36:08.742 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:27: finishing write tid 2 to trial04641590-27 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:27: finishing write tid 3 to trial04641590-27 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:27: finishing write tid 4 to trial04641590-27 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:27: oid 27 updating version 0 to 3 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:27: oid 27 version 3 is already newer than 3 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:27: oid 27 version 3 is already newer than 1 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 27 v 3 (ObjNum 26 snap 0 seq_num 26) dirty exists 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:28: finishing write tid 2 to trial04641590-28 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:27: done (15 left) 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:53: read oid 2 snap -1 2026-02-20T11:36:08.743 INFO:tasks.rados.rados.0.trial046.stdout:53: expect (ObjNum 1 snap 0 seq_num 1) 2026-02-20T11:36:08.744 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.744 INFO:tasks.rados.rados.0.trial046.stdout:50: finishing write tid 1 to trial04641590-50 2026-02-20T11:36:08.744 INFO:tasks.rados.rados.0.trial046.stdout:47: finishing write tid 1 to trial04641590-47 2026-02-20T11:36:08.746 INFO:tasks.rados.rados.0.trial046.stdout:50: finishing write tid 2 to trial04641590-50 2026-02-20T11:36:08.747 INFO:tasks.rados.rados.0.trial046.stdout:51: finishing write tid 1 to trial04641590-23 2026-02-20T11:36:08.750 INFO:tasks.rados.rados.0.trial046.stdout:28: finishing write tid 3 to trial04641590-28 2026-02-20T11:36:08.751 INFO:tasks.rados.rados.0.trial046.stdout:50: finishing write tid 3 to trial04641590-50 2026-02-20T11:36:08.752 INFO:tasks.rados.rados.0.trial046.stdout:50: finishing write tid 4 to trial04641590-50 2026-02-20T11:36:08.753 INFO:tasks.rados.rados.0.trial046.stdout:50: oid 50 updating version 0 to 7 2026-02-20T11:36:08.753 INFO:tasks.rados.rados.0.trial046.stdout:50: oid 50 updating version 7 to 9 2026-02-20T11:36:08.753 INFO:tasks.rados.rados.0.trial046.stdout:50: oid 50 version 9 is already newer than 9 2026-02-20T11:36:08.753 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 50 v 9 (ObjNum 49 snap 0 seq_num 49) dirty exists 2026-02-20T11:36:08.753 INFO:tasks.rados.rados.0.trial046.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2026-02-20T11:36:08.753 INFO:tasks.rados.rados.0.trial046.stdout:50: done (15 left) 2026-02-20T11:36:08.753 INFO:tasks.rados.rados.0.trial046.stdout:54: read oid 35 snap -1 2026-02-20T11:36:08.753 INFO:tasks.rados.rados.0.trial046.stdout:54: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-20T11:36:08.753 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.754 INFO:tasks.rados.rados.0.trial046.stdout:46: finishing write tid 1 to trial04641590-46 2026-02-20T11:36:08.755 INFO:tasks.rados.rados.0.trial046.stdout:28: finishing write tid 4 to trial04641590-28 2026-02-20T11:36:08.756 INFO:tasks.rados.rados.0.trial046.stdout:28: oid 28 updating version 0 to 7 2026-02-20T11:36:08.756 INFO:tasks.rados.rados.0.trial046.stdout:28: oid 28 updating version 7 to 9 2026-02-20T11:36:08.756 INFO:tasks.rados.rados.0.trial046.stdout:28: oid 28 version 9 is already newer than 9 2026-02-20T11:36:08.756 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 28 v 9 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-20T11:36:08.756 INFO:tasks.rados.rados.0.trial046.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2026-02-20T11:36:08.756 INFO:tasks.rados.rados.0.trial046.stdout:28: done (15 left) 2026-02-20T11:36:08.756 INFO:tasks.rados.rados.0.trial046.stdout:55: read oid 27 snap -1 2026-02-20T11:36:08.756 INFO:tasks.rados.rados.0.trial046.stdout:55: expect (ObjNum 26 snap 0 seq_num 26) 2026-02-20T11:36:08.756 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.759 INFO:tasks.rados.rados.0.trial046.stdout:47: finishing write tid 2 to trial04641590-47 2026-02-20T11:36:08.762 INFO:tasks.rados.rados.0.trial046.stdout:53: expect (ObjNum 1 snap 0 seq_num 1) 2026-02-20T11:36:08.762 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 0 2026-02-20T11:36:08.782 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 664406 2026-02-20T11:36:08.793 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 0 2026-02-20T11:36:08.811 INFO:tasks.rados.rados.0.trial046.stdout:53: done (15 left) 2026-02-20T11:36:08.811 INFO:tasks.rados.rados.0.trial046.stdout:56: read oid 3 snap -1 2026-02-20T11:36:08.811 INFO:tasks.rados.rados.0.trial046.stdout:56: expect (ObjNum 2 snap 0 seq_num 2) 2026-02-20T11:36:08.811 INFO:tasks.rados.rados.0.trial046.stdout: waiting on 16 2026-02-20T11:36:08.811 INFO:tasks.rados.rados.0.trial046.stdout:22: finishing write tid 1 to trial04641590-22 2026-02-20T11:36:08.811 INFO:tasks.rados.rados.0.trial046.stdout:51: finishing write tid 2 to trial04641590-23 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:47: finishing write tid 3 to trial04641590-47 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:47: finishing write tid 4 to trial04641590-47 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:47: oid 47 updating version 0 to 7 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:47: oid 47 updating version 7 to 9 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:47: oid 47 version 9 is already newer than 9 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 47 v 9 (ObjNum 46 snap 0 seq_num 46) dirty exists 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:51: finishing write tid 3 to trial04641590-23 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:51: finishing write tid 4 to trial04641590-23 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:51: finishing write tid 5 to trial04641590-23 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:51: oid 23 updating version 0 to 13 2026-02-20T11:36:08.812 INFO:tasks.rados.rados.0.trial046.stdout:51: oid 23 version 13 is already newer than 13 2026-02-20T11:36:08.813 INFO:tasks.rados.rados.0.trial046.stdout:51: oid 23 version 13 is already newer than 13 2026-02-20T11:36:08.813 INFO:tasks.rados.rados.0.trial046.stdout:51: oid 23 version 13 is already newer than 10 2026-02-20T11:36:08.813 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 23 v 13 (ObjNum 50 snap 0 seq_num 50) dirty exists 2026-02-20T11:36:08.813 INFO:tasks.rados.rados.0.trial046.stdout:51: left oid 23 (ObjNum 50 snap 0 seq_num 50) 2026-02-20T11:36:08.813 INFO:tasks.rados.rados.0.trial046.stdout:46: finishing write tid 2 to trial04641590-46 2026-02-20T11:36:08.813 INFO:tasks.rados.rados.0.trial046.stdout:41: finishing write tid 1 to trial04641590-41 2026-02-20T11:36:08.813 INFO:tasks.rados.rados.0.trial046.stdout:22: finishing write tid 2 to trial04641590-22 2026-02-20T11:36:08.813 INFO:tasks.rados.rados.0.trial046.stdout:54: expect (ObjNum 34 snap 0 seq_num 34) 2026-02-20T11:36:08.838 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 2164892 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:22: finishing write tid 3 to trial04641590-22 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:46: finishing write tid 3 to trial04641590-46 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:47: done (15 left) 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:51: done (14 left) 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:54: done (13 left) 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:57: read oid 10 snap -1 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:57: expect (ObjNum 9 snap 0 seq_num 9) 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:58: delete oid 26 current snap is 0 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:46: finishing write tid 4 to trial04641590-46 2026-02-20T11:36:08.854 INFO:tasks.rados.rados.0.trial046.stdout:46: oid 46 updating version 0 to 6 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:46: oid 46 version 6 is already newer than 6 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:46: oid 46 version 6 is already newer than 4 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 46 v 6 (ObjNum 45 snap 0 seq_num 45) dirty exists 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:22: finishing write tid 4 to trial04641590-22 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:22: oid 22 updating version 0 to 21 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:22: oid 22 version 21 is already newer than 19 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:22: oid 22 version 21 is already newer than 21 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 22 v 21 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:49: finishing write tid 1 to trial04641590-49 2026-02-20T11:36:08.855 INFO:tasks.rados.rados.0.trial046.stdout:39: finishing write tid 1 to trial04641590-39 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:49: finishing write tid 2 to trial04641590-49 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:41: finishing write tid 2 to trial04641590-41 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:41: finishing write tid 3 to trial04641590-41 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:41: finishing write tid 4 to trial04641590-41 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:41: oid 41 updating version 0 to 9 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:41: oid 41 version 9 is already newer than 9 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:41: oid 41 version 9 is already newer than 7 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 41 v 9 (ObjNum 40 snap 0 seq_num 40) dirty exists 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:39: finishing write tid 2 to trial04641590-39 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:49: finishing write tid 3 to trial04641590-49 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:49: finishing write tid 4 to trial04641590-49 2026-02-20T11:36:08.856 INFO:tasks.rados.rados.0.trial046.stdout:49: oid 49 updating version 0 to 9 2026-02-20T11:36:08.857 INFO:tasks.rados.rados.0.trial046.stdout:49: oid 49 version 9 is already newer than 9 2026-02-20T11:36:08.857 INFO:tasks.rados.rados.0.trial046.stdout:49: oid 49 version 9 is already newer than 7 2026-02-20T11:36:08.857 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-20T11:36:08.857 INFO:tasks.rados.rados.0.trial046.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2026-02-20T11:36:08.857 INFO:tasks.rados.rados.0.trial046.stdout:39: finishing write tid 3 to trial04641590-39 2026-02-20T11:36:08.857 INFO:tasks.rados.rados.0.trial046.stdout:55: expect (ObjNum 26 snap 0 seq_num 26) 2026-02-20T11:36:08.877 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 2107738 2026-02-20T11:36:08.879 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 0 2026-02-20T11:36:08.900 INFO:tasks.rados.rados.0.trial046.stdout:22: done (14 left) 2026-02-20T11:36:08.900 INFO:tasks.rados.rados.0.trial046.stdout:41: done (13 left) 2026-02-20T11:36:08.900 INFO:tasks.rados.rados.0.trial046.stdout:46: done (12 left) 2026-02-20T11:36:08.901 INFO:tasks.rados.rados.0.trial046.stdout:49: done (11 left) 2026-02-20T11:36:08.901 INFO:tasks.rados.rados.0.trial046.stdout:55: done (10 left) 2026-02-20T11:36:08.901 INFO:tasks.rados.rados.0.trial046.stdout:58: done (9 left) 2026-02-20T11:36:08.901 INFO:tasks.rados.rados.0.trial046.stdout:59: write oid 38 current snap is 0 2026-02-20T11:36:08.901 INFO:tasks.rados.rados.0.trial046.stdout:56: expect (ObjNum 2 snap 0 seq_num 2) 2026-02-20T11:36:08.901 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 49191 2026-02-20T11:36:08.917 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 363198 2026-02-20T11:36:08.950 INFO:tasks.rados.rados.0.trial046.stdout:39: finishing write tid 4 to trial04641590-39 2026-02-20T11:36:08.950 INFO:tasks.rados.rados.0.trial046.stdout:39: oid 39 updating version 0 to 24 2026-02-20T11:36:08.950 INFO:tasks.rados.rados.0.trial046.stdout:39: oid 39 version 24 is already newer than 22 2026-02-20T11:36:08.950 INFO:tasks.rados.rados.0.trial046.stdout:39: oid 39 version 24 is already newer than 24 2026-02-20T11:36:08.950 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 39 v 24 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-20T11:36:08.950 INFO:tasks.rados.rados.0.trial046.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2026-02-20T11:36:08.950 INFO:tasks.rados.rados.0.trial046.stdout:48: finishing write tid 1 to trial04641590-48 2026-02-20T11:36:08.950 INFO:tasks.rados.rados.0.trial046.stdout:59: seq_num 53 ranges {490771=686315,1885075=406346} 2026-02-20T11:36:08.954 INFO:tasks.rados.rados.0.trial046.stdout:59: writing trial04641590-38 from 490771 to 1177086 tid 1 2026-02-20T11:36:08.959 INFO:tasks.rados.rados.0.trial046.stdout:59: writing trial04641590-38 from 1885075 to 2291421 tid 2 2026-02-20T11:36:08.959 INFO:tasks.rados.rados.0.trial046.stdout:39: done (9 left) 2026-02-20T11:36:08.959 INFO:tasks.rados.rados.0.trial046.stdout:56: done (8 left) 2026-02-20T11:36:08.959 INFO:tasks.rados.rados.0.trial046.stdout:60: write oid 16 current snap is 0 2026-02-20T11:36:08.959 INFO:tasks.rados.rados.0.trial046.stdout:48: finishing write tid 2 to trial04641590-48 2026-02-20T11:36:08.959 INFO:tasks.rados.rados.0.trial046.stdout:60: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2026-02-20T11:36:08.962 INFO:tasks.rados.rados.0.trial046.stdout:60: writing trial04641590-16 from 507578 to 985495 tid 1 2026-02-20T11:36:08.966 INFO:tasks.rados.rados.0.trial046.stdout:60: writing trial04641590-16 from 1543557 to 2093561 tid 2 2026-02-20T11:36:08.970 INFO:tasks.rados.rados.0.trial046.stdout:60: writing trial04641590-16 from 2833665 to 2907578 tid 3 2026-02-20T11:36:08.970 INFO:tasks.rados.rados.0.trial046.stdout:61: read oid 19 snap -1 2026-02-20T11:36:08.970 INFO:tasks.rados.rados.0.trial046.stdout:61: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:62: snap_create 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:48: finishing write tid 3 to trial04641590-48 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:48: finishing write tid 4 to trial04641590-48 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:48: oid 48 updating version 0 to 27 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:48: oid 48 version 27 is already newer than 27 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:48: oid 48 version 27 is already newer than 25 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 48 v 27 (ObjNum 47 snap 0 seq_num 47) dirty exists 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:52: finishing write tid 1 to trial04641590-14 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:20: finishing write tid 1 to trial04641590-20 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:52: finishing write tid 2 to trial04641590-14 2026-02-20T11:36:08.971 INFO:tasks.rados.rados.0.trial046.stdout:52: finishing write tid 3 to trial04641590-14 2026-02-20T11:36:08.972 INFO:tasks.rados.rados.0.trial046.stdout:57: expect (ObjNum 9 snap 0 seq_num 9) 2026-02-20T11:36:08.979 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 0 2026-02-20T11:36:09.016 INFO:tasks.rados.rados.0.trial046.stdout:52: finishing write tid 4 to trial04641590-14 2026-02-20T11:36:09.016 INFO:tasks.rados.rados.0.trial046.stdout:52: oid 14 updating version 0 to 30 2026-02-20T11:36:09.016 INFO:tasks.rados.rados.0.trial046.stdout:52: oid 14 version 30 is already newer than 28 2026-02-20T11:36:09.016 INFO:tasks.rados.rados.0.trial046.stdout:52: oid 14 version 30 is already newer than 30 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 14 v 30 (ObjNum 51 snap 0 seq_num 51) dirty exists 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:52: left oid 14 (ObjNum 51 snap 0 seq_num 51) 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:20: finishing write tid 2 to trial04641590-20 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:20: finishing write tid 3 to trial04641590-20 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:20: finishing write tid 4 to trial04641590-20 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:20: oid 20 updating version 0 to 3 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:20: oid 20 version 3 is already newer than 1 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:20: oid 20 version 3 is already newer than 3 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 20 v 3 (ObjNum 19 snap 0 seq_num 19) dirty exists 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2026-02-20T11:36:09.017 INFO:tasks.rados.rados.0.trial046.stdout:21: finishing write tid 1 to trial04641590-21 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:21: finishing write tid 2 to trial04641590-21 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:21: finishing write tid 3 to trial04641590-21 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:21: finishing write tid 4 to trial04641590-21 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:21: oid 21 updating version 0 to 4 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:21: oid 21 updating version 4 to 6 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:21: oid 21 version 6 is already newer than 6 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 21 v 6 (ObjNum 20 snap 0 seq_num 20) dirty exists 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:40: finishing write tid 1 to trial04641590-40 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:40: finishing write tid 2 to trial04641590-40 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:59: finishing write tid 1 to trial04641590-38 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:40: finishing write tid 3 to trial04641590-40 2026-02-20T11:36:09.018 INFO:tasks.rados.rados.0.trial046.stdout:40: finishing write tid 4 to trial04641590-40 2026-02-20T11:36:09.019 INFO:tasks.rados.rados.0.trial046.stdout:40: oid 40 updating version 0 to 9 2026-02-20T11:36:09.019 INFO:tasks.rados.rados.0.trial046.stdout:40: oid 40 version 9 is already newer than 9 2026-02-20T11:36:09.019 INFO:tasks.rados.rados.0.trial046.stdout:40: oid 40 version 9 is already newer than 7 2026-02-20T11:36:09.019 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 40 v 9 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-20T11:36:09.019 INFO:tasks.rados.rados.0.trial046.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2026-02-20T11:36:09.019 INFO:tasks.rados.rados.0.trial046.stdout:45: finishing write tid 1 to trial04641590-45 2026-02-20T11:36:09.019 INFO:tasks.rados.rados.0.trial046.stdout:59: finishing write tid 2 to trial04641590-38 2026-02-20T11:36:09.019 INFO:tasks.rados.rados.0.trial046.stdout:61: expect (ObjNum 18 snap 0 seq_num 18) 2026-02-20T11:36:09.054 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 306246 2026-02-20T11:36:09.071 INFO:tasks.rados.rados.0.trial046.stdout:60: finishing write tid 1 to trial04641590-16 2026-02-20T11:36:09.071 INFO:tasks.rados.rados.0.trial046.stdout:59: finishing write tid 3 to trial04641590-38 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:45: finishing write tid 2 to trial04641590-45 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:59: finishing write tid 4 to trial04641590-38 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:59: oid 38 updating version 0 to 12 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:59: oid 38 version 12 is already newer than 12 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:59: oid 38 version 12 is already newer than 12 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 38 v 12 (ObjNum 53 snap 0 seq_num 53) dirty exists 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:59: left oid 38 (ObjNum 53 snap 0 seq_num 53) 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:45: finishing write tid 3 to trial04641590-45 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:45: finishing write tid 4 to trial04641590-45 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:45: oid 45 updating version 0 to 12 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:45: oid 45 version 12 is already newer than 10 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:45: oid 45 version 12 is already newer than 12 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 45 v 12 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:60: finishing write tid 2 to trial04641590-16 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:60: finishing write tid 3 to trial04641590-16 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:60: finishing write tid 4 to trial04641590-16 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:60: finishing write tid 5 to trial04641590-16 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:60: oid 16 updating version 0 to 16 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:60: oid 16 version 16 is already newer than 16 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:60: oid 16 version 16 is already newer than 16 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:60: oid 16 version 16 is already newer than 16 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 16 v 16 (ObjNum 54 snap 0 seq_num 54) dirty exists 2026-02-20T11:36:09.072 INFO:tasks.rados.rados.0.trial046.stdout:60: left oid 16 (ObjNum 54 snap 0 seq_num 54) 2026-02-20T11:36:09.225 INFO:tasks.rados.rados.0.trial046.stdout:20: done (10 left) 2026-02-20T11:36:09.225 INFO:tasks.rados.rados.0.trial046.stdout:21: done (9 left) 2026-02-20T11:36:09.225 INFO:tasks.rados.rados.0.trial046.stdout:40: done (8 left) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:45: done (7 left) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:48: done (6 left) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:52: done (5 left) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:57: done (4 left) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:59: done (3 left) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:60: done (2 left) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:61: done (1 left) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:62: done (0 left) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:63: read oid 49 snap -1 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:63: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-20T11:36:09.226 INFO:tasks.rados.rados.0.trial046.stdout:64: delete oid 24 current snap is 1 2026-02-20T11:36:09.261 INFO:tasks.rados.rados.0.trial046.stdout:63: expect (ObjNum 48 snap 0 seq_num 48) 2026-02-20T11:36:09.332 INFO:tasks.rados.rados.0.trial046.stdout:63: done (1 left) 2026-02-20T11:36:09.332 INFO:tasks.rados.rados.0.trial046.stdout:64: done (0 left) 2026-02-20T11:36:09.332 INFO:tasks.rados.rados.0.trial046.stdout:65: read oid 39 snap 0 2026-02-20T11:36:09.332 INFO:tasks.rados.rados.0.trial046.stdout:65: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-20T11:36:09.332 INFO:tasks.rados.rados.0.trial046.stdout:66: read oid 16 snap -1 2026-02-20T11:36:09.332 INFO:tasks.rados.rados.0.trial046.stdout:66: expect (ObjNum 54 snap 0 seq_num 54) 2026-02-20T11:36:09.332 INFO:tasks.rados.rados.0.trial046.stdout:67: write oid 45 current snap is 1 2026-02-20T11:36:09.333 INFO:tasks.rados.rados.0.trial046.stdout:67: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2026-02-20T11:36:09.336 INFO:tasks.rados.rados.0.trial046.stdout:67: writing trial04641590-45 from 541192 to 1169607 tid 1 2026-02-20T11:36:09.340 INFO:tasks.rados.rados.0.trial046.stdout:67: writing trial04641590-45 from 1660521 to 2214194 tid 2 2026-02-20T11:36:09.343 INFO:tasks.rados.rados.0.trial046.stdout:67: writing trial04641590-45 from 2888511 to 2941192 tid 3 2026-02-20T11:36:09.343 INFO:tasks.rados.rados.0.trial046.stdout:68: read oid 48 snap -1 2026-02-20T11:36:09.343 INFO:tasks.rados.rados.0.trial046.stdout:68: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-20T11:36:09.343 INFO:tasks.rados.rados.0.trial046.stdout:69: snap_create 2026-02-20T11:36:09.351 INFO:tasks.rados.rados.0.trial046.stdout:66: expect (ObjNum 54 snap 0 seq_num 54) 2026-02-20T11:36:09.352 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 0 2026-02-20T11:36:09.360 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-20T11:36:09.360 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:36:09.360 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2, 3] 2026-02-20T11:36:09.361 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T11:36:09.361 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:36:09.442 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T11:36:09.442 INFO:tasks.rados.rados.0.trial046.stdout:65: expect (ObjNum 38 snap 0 seq_num 38) 2026-02-20T11:36:09.443 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 0 2026-02-20T11:36:09.482 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 0 2026-02-20T11:36:09.505 INFO:tasks.rados.rados.0.trial046.stdout:68: expect (ObjNum 47 snap 0 seq_num 47) 2026-02-20T11:36:09.505 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 0 2026-02-20T11:36:09.543 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 995082 2026-02-20T11:36:10.229 INFO:tasks.rados.rados.0.trial046.stdout:65: done (4 left) 2026-02-20T11:36:10.229 INFO:tasks.rados.rados.0.trial046.stdout:66: done (3 left) 2026-02-20T11:36:10.229 INFO:tasks.rados.rados.0.trial046.stdout:68: done (2 left) 2026-02-20T11:36:10.229 INFO:tasks.rados.rados.0.trial046.stdout:69: done (1 left) 2026-02-20T11:36:10.229 INFO:tasks.rados.rados.0.trial046.stdout:70: delete oid 12 current snap is 2 2026-02-20T11:36:10.261 INFO:tasks.rados.rados.0.trial046.stdout:70: done (1 left) 2026-02-20T11:36:10.261 INFO:tasks.rados.rados.0.trial046.stdout:71: snap_remove snap 1 2026-02-20T11:36:10.666 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:10.742 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:10.740+0000 7f6616fec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:10.745 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:10.744+0000 7f6616fec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:11.230 INFO:tasks.rados.rados.0.trial046.stdout:71: done (1 left) 2026-02-20T11:36:11.230 INFO:tasks.rados.rados.0.trial046.stdout:72: read oid 6 snap -1 2026-02-20T11:36:11.231 INFO:tasks.rados.rados.0.trial046.stdout:72: expect (ObjNum 5 snap 0 seq_num 5) 2026-02-20T11:36:11.231 INFO:tasks.rados.rados.0.trial046.stdout:73: write oid 47 current snap is 2 2026-02-20T11:36:11.231 INFO:tasks.rados.rados.0.trial046.stdout:73: seq_num 58 ranges {574806=778913,2061132=557342} 2026-02-20T11:36:11.235 INFO:tasks.rados.rados.0.trial046.stdout:73: writing trial04641590-47 from 574806 to 1353719 tid 1 2026-02-20T11:36:11.240 INFO:tasks.rados.rados.0.trial046.stdout:73: writing trial04641590-47 from 2061132 to 2618474 tid 2 2026-02-20T11:36:11.240 INFO:tasks.rados.rados.0.trial046.stdout:74: write (excl) oid 8 current snap is 2 2026-02-20T11:36:11.241 INFO:tasks.rados.rados.0.trial046.stdout:74: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2026-02-20T11:36:11.244 INFO:tasks.rados.rados.0.trial046.stdout:74: writing trial04641590-8 from 591613 to 1045775 tid 1 2026-02-20T11:36:11.249 INFO:tasks.rados.rados.0.trial046.stdout:74: writing trial04641590-8 from 1719614 to 2136967 tid 2 2026-02-20T11:36:11.253 INFO:tasks.rados.rados.0.trial046.stdout:74: writing trial04641590-8 from 2570780 to 2991613 tid 3 2026-02-20T11:36:11.253 INFO:tasks.rados.rados.0.trial046.stdout:75: write (excl) oid 32 current snap is 2 2026-02-20T11:36:11.253 INFO:tasks.rados.rados.0.trial046.stdout:75: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2026-02-20T11:36:11.257 INFO:tasks.rados.rados.0.trial046.stdout:75: writing trial04641590-32 from 608420 to 1137831 tid 1 2026-02-20T11:36:11.262 INFO:tasks.rados.rados.0.trial046.stdout:75: writing trial04641590-32 from 1778096 to 2339107 tid 2 2026-02-20T11:36:11.265 INFO:tasks.rados.rados.0.trial046.stdout:75: writing trial04641590-32 from 2881850 to 3008420 tid 3 2026-02-20T11:36:11.265 INFO:tasks.rados.rados.0.trial046.stdout:76: snap_remove snap 0 2026-02-20T11:36:12.236 INFO:tasks.rados.rados.0.trial046.stdout:76: done (5 left) 2026-02-20T11:36:12.236 INFO:tasks.rados.rados.0.trial046.stdout:77: write oid 28 current snap is 2 2026-02-20T11:36:12.236 INFO:tasks.rados.rados.0.trial046.stdout:75: finishing write tid 1 to trial04641590-32 2026-02-20T11:36:12.236 INFO:tasks.rados.rados.0.trial046.stdout:77: seq_num 61 ranges {625227=721013,1952931=704669} 2026-02-20T11:36:12.241 INFO:tasks.rados.rados.0.trial046.stdout:77: writing trial04641590-28 from 625227 to 1346240 tid 1 2026-02-20T11:36:12.246 INFO:tasks.rados.rados.0.trial046.stdout:77: writing trial04641590-28 from 1952931 to 2657600 tid 2 2026-02-20T11:36:12.246 INFO:tasks.rados.rados.0.trial046.stdout:78: snap_create 2026-02-20T11:36:12.246 INFO:tasks.rados.rados.0.trial046.stdout:75: finishing write tid 2 to trial04641590-32 2026-02-20T11:36:12.247 INFO:tasks.rados.rados.0.trial046.stdout:75: finishing write tid 3 to trial04641590-32 2026-02-20T11:36:12.247 INFO:tasks.rados.rados.0.trial046.stdout:75: finishing write tid 4 to trial04641590-32 2026-02-20T11:36:12.247 INFO:tasks.rados.rados.0.trial046.stdout:75: finishing write tid 5 to trial04641590-32 2026-02-20T11:36:12.247 INFO:tasks.rados.rados.0.trial046.stdout:75: oid 32 updating version 0 to 21 2026-02-20T11:36:12.247 INFO:tasks.rados.rados.0.trial046.stdout:75: oid 32 version 21 is already newer than 18 2026-02-20T11:36:12.247 INFO:tasks.rados.rados.0.trial046.stdout:75: oid 32 version 21 is already newer than 21 2026-02-20T11:36:12.247 INFO:tasks.rados.rados.0.trial046.stdout:75: oid 32 version 21 is already newer than 21 2026-02-20T11:36:12.247 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 32 v 21 (ObjNum 60 snap 2 seq_num 60) dirty exists 2026-02-20T11:36:12.247 INFO:tasks.rados.rados.0.trial046.stdout:75: left oid 32 (ObjNum 60 snap 2 seq_num 60) 2026-02-20T11:36:12.306 INFO:tasks.rados.rados.0.trial046.stdout:77: finishing write tid 1 to trial04641590-28 2026-02-20T11:36:12.311 INFO:tasks.rados.rados.0.trial046.stdout:77: finishing write tid 2 to trial04641590-28 2026-02-20T11:36:12.313 INFO:tasks.rados.rados.0.trial046.stdout:77: finishing write tid 3 to trial04641590-28 2026-02-20T11:36:12.315 INFO:tasks.rados.rados.0.trial046.stdout:77: finishing write tid 4 to trial04641590-28 2026-02-20T11:36:12.315 INFO:tasks.rados.rados.0.trial046.stdout:77: oid 28 updating version 0 to 12 2026-02-20T11:36:12.316 INFO:tasks.rados.rados.0.trial046.stdout:77: oid 28 version 12 is already newer than 12 2026-02-20T11:36:12.316 INFO:tasks.rados.rados.0.trial046.stdout:77: oid 28 version 12 is already newer than 12 2026-02-20T11:36:12.316 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 28 v 12 (ObjNum 61 snap 2 seq_num 61) dirty exists 2026-02-20T11:36:12.316 INFO:tasks.rados.rados.0.trial046.stdout:77: left oid 28 (ObjNum 61 snap 2 seq_num 61) 2026-02-20T11:36:13.239 INFO:tasks.rados.rados.0.trial046.stdout:75: done (6 left) 2026-02-20T11:36:13.240 INFO:tasks.rados.rados.0.trial046.stdout:77: done (5 left) 2026-02-20T11:36:13.240 INFO:tasks.rados.rados.0.trial046.stdout:78: done (4 left) 2026-02-20T11:36:13.240 INFO:tasks.rados.rados.0.trial046.stdout:79: write oid 31 current snap is 3 2026-02-20T11:36:13.240 INFO:tasks.rados.rados.0.trial046.stdout:79: seq_num 62 ranges {642034=796262,1895060=564680} 2026-02-20T11:36:13.245 INFO:tasks.rados.rados.0.trial046.stdout:79: writing trial04641590-31 from 642034 to 1438296 tid 1 2026-02-20T11:36:13.250 INFO:tasks.rados.rados.0.trial046.stdout:79: writing trial04641590-31 from 1895060 to 2459740 tid 2 2026-02-20T11:36:13.250 INFO:tasks.rados.rados.0.trial046.stdout:80: write oid 30 current snap is 3 2026-02-20T11:36:13.250 INFO:tasks.rados.rados.0.trial046.stdout:80: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2026-02-20T11:36:13.254 INFO:tasks.rados.rados.0.trial046.stdout:80: writing trial04641590-30 from 658841 to 1130352 tid 1 2026-02-20T11:36:13.258 INFO:tasks.rados.rados.0.trial046.stdout:80: writing trial04641590-30 from 1553542 to 2261880 tid 2 2026-02-20T11:36:13.261 INFO:tasks.rados.rados.0.trial046.stdout:80: writing trial04641590-30 from 2964119 to 3058841 tid 3 2026-02-20T11:36:13.262 INFO:tasks.rados.rados.0.trial046.stdout:81: write oid 48 current snap is 3 2026-02-20T11:36:13.262 INFO:tasks.rados.rados.0.trial046.stdout:81: seq_num 64 ranges {675648=546760,2012024=568349} 2026-02-20T11:36:13.266 INFO:tasks.rados.rados.0.trial046.stdout:81: writing trial04641590-48 from 675648 to 1222408 tid 1 2026-02-20T11:36:13.271 INFO:tasks.rados.rados.0.trial046.stdout:81: writing trial04641590-48 from 2012024 to 2580373 tid 2 2026-02-20T11:36:13.271 INFO:tasks.rados.rados.0.trial046.stdout:82: delete oid 26 current snap is 3 2026-02-20T11:36:14.442 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [0, 1, 3] 2026-02-20T11:36:14.443 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:36:14.443 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:36:14.522 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:14.519+0000 7f96b7be4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:14.524 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:14.523+0000 7f96b7be4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:14.637 INFO:teuthology.orchestra.run.trial046.stdout: 2026-02-20T11:36:14.638 INFO:teuthology.orchestra.run.trial046.stderr:dumped all 2026-02-20T11:36:14.647 INFO:teuthology.orchestra.run.trial046.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-20T11:36:13.975646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":87515036,"num_objects":44,"num_object_clones":4,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":183,"num_read_kb":39103,"num_write":259,"num_write_kb":49501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":208666624,"kb_used":140224,"kb_used_data":140224,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":208526400,"statfs":{"total":213674622976,"available":213531033600,"internally_reserved":0,"allocated":143589376,"data_stored":143589376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":86924649,"num_objects":40,"num_object_clones":4,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":130,"num_read_kb":39057,"num_write":178,"num_write_kb":48393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000868"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:36:06.317668+0000","last_change":"2026-02-20T11:36:06.318196+0000","last_active":"2026-02-20T11:36:06.317668+0000","last_peered":"2026-02-20T11:36:06.317668+0000","last_clean":"2026-02-20T11:36:05.201041+0000","last_became_active":"2026-02-20T11:36:06.314172+0000","last_became_peered":"2026-02-20T11:36:06.314172+0000","last_unstale":"2026-02-20T11:36:06.317668+0000","last_undegraded":"2026-02-20T11:36:06.317668+0000","last_fullsized":"2026-02-20T11:36:06.317668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:36:06.291462+0000","last_change":"2026-02-20T11:36:06.292050+0000","last_active":"2026-02-20T11:36:06.291462+0000","last_peered":"2026-02-20T11:36:06.291462+0000","last_clean":"2026-02-20T11:36:05.201041+0000","last_became_active":"2026-02-20T11:36:06.268686+0000","last_became_peered":"2026-02-20T11:36:06.268686+0000","last_unstale":"2026-02-20T11:36:06.291462+0000","last_undegraded":"2026-02-20T11:36:06.291462+0000","last_fullsized":"2026-02-20T11:36:06.291462+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'9","reported_seq":43,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.238592+0000","last_change":"2026-02-20T11:36:11.244932+0000","last_active":"2026-02-20T11:36:11.238592+0000","last_peered":"2026-02-20T11:36:11.238592+0000","last_clean":"2026-02-20T11:36:11.238592+0000","last_became_active":"2026-02-20T11:36:06.258923+0000","last_became_peered":"2026-02-20T11:36:06.258923+0000","last_unstale":"2026-02-20T11:36:11.238592+0000","last_undegraded":"2026-02-20T11:36:11.238592+0000","last_fullsized":"2026-02-20T11:36:11.238592+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8000033,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":6727,"num_write":12,"num_write_kb":4116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"22'21","reported_seq":54,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.283590+0000","last_change":"2026-02-20T11:36:11.245192+0000","last_active":"2026-02-20T11:36:11.283590+0000","last_peered":"2026-02-20T11:36:11.283590+0000","last_clean":"2026-02-20T11:36:11.283590+0000","last_became_active":"2026-02-20T11:36:06.264845+0000","last_became_peered":"2026-02-20T11:36:06.264845+0000","last_unstale":"2026-02-20T11:36:11.283590+0000","last_undegraded":"2026-02-20T11:36:11.283590+0000","last_fullsized":"2026-02-20T11:36:11.283590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075681,"num_objects":5,"num_object_clones":1,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":4096,"num_write":26,"num_write_kb":6672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"19'13","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:36:10.237208+0000","last_change":"2026-02-20T11:36:06.299774+0000","last_active":"2026-02-20T11:36:10.237208+0000","last_peered":"2026-02-20T11:36:10.237208+0000","last_clean":"2026-02-20T11:36:10.237208+0000","last_became_active":"2026-02-20T11:36:06.293748+0000","last_became_peered":"2026-02-20T11:36:06.293748+0000","last_unstale":"2026-02-20T11:36:10.237208+0000","last_undegraded":"2026-02-20T11:36:10.237208+0000","last_fullsized":"2026-02-20T11:36:10.237208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7428595,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":17,"num_write_kb":4301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"19'18","reported_seq":55,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.239129+0000","last_change":"2026-02-20T11:36:11.244823+0000","last_active":"2026-02-20T11:36:11.239129+0000","last_peered":"2026-02-20T11:36:11.239129+0000","last_clean":"2026-02-20T11:36:11.239129+0000","last_became_active":"2026-02-20T11:36:06.284798+0000","last_became_peered":"2026-02-20T11:36:06.284798+0000","last_unstale":"2026-02-20T11:36:11.239129+0000","last_undegraded":"2026-02-20T11:36:11.239129+0000","last_fullsized":"2026-02-20T11:36:11.239129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14050454,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":8826,"num_write":24,"num_write_kb":6885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'9","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.240998+0000","last_change":"2026-02-20T11:36:11.245238+0000","last_active":"2026-02-20T11:36:11.240998+0000","last_peered":"2026-02-20T11:36:11.240998+0000","last_clean":"2026-02-20T11:36:11.240998+0000","last_became_active":"2026-02-20T11:36:06.290770+0000","last_became_peered":"2026-02-20T11:36:06.290770+0000","last_unstale":"2026-02-20T11:36:11.240998+0000","last_undegraded":"2026-02-20T11:36:11.240998+0000","last_fullsized":"2026-02-20T11:36:11.240998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6890771,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":3267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"19'3","reported_seq":28,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:36:10.236894+0000","last_change":"2026-02-20T11:36:06.280140+0000","last_active":"2026-02-20T11:36:10.236894+0000","last_peered":"2026-02-20T11:36:10.236894+0000","last_clean":"2026-02-20T11:36:10.236894+0000","last_became_active":"2026-02-20T11:36:06.275905+0000","last_became_peered":"2026-02-20T11:36:06.275905+0000","last_unstale":"2026-02-20T11:36:10.236894+0000","last_undegraded":"2026-02-20T11:36:10.236894+0000","last_fullsized":"2026-02-20T11:36:10.236894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2016807,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5262,"num_write":4,"num_write_kb":929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.238812+0000","last_change":"2026-02-20T11:36:01.022683+0000","last_active":"2026-02-20T11:36:11.238812+0000","last_peered":"2026-02-20T11:36:11.238812+0000","last_clean":"2026-02-20T11:36:11.238812+0000","last_became_active":"2026-02-20T11:35:59.079114+0000","last_became_peered":"2026-02-20T11:35:59.079114+0000","last_unstale":"2026-02-20T11:36:11.238812+0000","last_undegraded":"2026-02-20T11:36:11.238812+0000","last_fullsized":"2026-02-20T11:36:11.238812+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"19'7","reported_seq":30,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:36:10.236812+0000","last_change":"2026-02-20T11:36:06.311877+0000","last_active":"2026-02-20T11:36:10.236812+0000","last_peered":"2026-02-20T11:36:10.236812+0000","last_clean":"2026-02-20T11:36:10.236812+0000","last_became_active":"2026-02-20T11:36:06.304554+0000","last_became_peered":"2026-02-20T11:36:06.304554+0000","last_unstale":"2026-02-20T11:36:10.236812+0000","last_undegraded":"2026-02-20T11:36:10.236812+0000","last_fullsized":"2026-02-20T11:36:10.236812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2722701,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":9,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.241820+0000","last_change":"2026-02-20T11:36:01.023332+0000","last_active":"2026-02-20T11:36:11.241820+0000","last_peered":"2026-02-20T11:36:11.241820+0000","last_clean":"2026-02-20T11:36:11.241820+0000","last_became_active":"2026-02-20T11:35:59.046602+0000","last_became_peered":"2026-02-20T11:35:59.046602+0000","last_unstale":"2026-02-20T11:36:11.241820+0000","last_undegraded":"2026-02-20T11:36:11.241820+0000","last_fullsized":"2026-02-20T11:36:11.241820+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:36:06.288634+0000","last_change":"2026-02-20T11:36:06.289200+0000","last_active":"2026-02-20T11:36:06.288634+0000","last_peered":"2026-02-20T11:36:06.288634+0000","last_clean":"2026-02-20T11:36:05.201041+0000","last_became_active":"2026-02-20T11:36:06.275422+0000","last_became_peered":"2026-02-20T11:36:06.275422+0000","last_unstale":"2026-02-20T11:36:06.288634+0000","last_undegraded":"2026-02-20T11:36:06.288634+0000","last_fullsized":"2026-02-20T11:36:06.288634+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"15'2","reported_seq":24,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:36:06.217785+0000","last_change":"2026-02-20T11:36:01.022784+0000","last_active":"2026-02-20T11:36:06.217785+0000","last_peered":"2026-02-20T11:36:06.217785+0000","last_clean":"2026-02-20T11:36:06.217785+0000","last_became_active":"2026-02-20T11:35:59.048324+0000","last_became_peered":"2026-02-20T11:35:59.048324+0000","last_unstale":"2026-02-20T11:36:06.217785+0000","last_undegraded":"2026-02-20T11:36:06.217785+0000","last_fullsized":"2026-02-20T11:36:06.217785+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'30","reported_seq":75,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.245270+0000","last_change":"2026-02-20T11:36:11.245270+0000","last_active":"2026-02-20T11:36:11.245270+0000","last_peered":"2026-02-20T11:36:11.245270+0000","last_clean":"2026-02-20T11:36:11.245270+0000","last_became_active":"2026-02-20T11:36:06.330733+0000","last_became_peered":"2026-02-20T11:36:06.330733+0000","last_unstale":"2026-02-20T11:36:11.245270+0000","last_undegraded":"2026-02-20T11:36:11.245270+0000","last_fullsized":"2026-02-20T11:36:11.245270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21395014,"num_objects":10,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":14130,"num_write":41,"num_write_kb":10614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":35,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:36:10.235538+0000","last_change":"2026-02-20T11:36:01.021350+0000","last_active":"2026-02-20T11:36:10.235538+0000","last_peered":"2026-02-20T11:36:10.235538+0000","last_clean":"2026-02-20T11:36:10.235538+0000","last_became_active":"2026-02-20T11:35:59.059484+0000","last_became_peered":"2026-02-20T11:35:59.059484+0000","last_unstale":"2026-02-20T11:36:10.235538+0000","last_undegraded":"2026-02-20T11:36:10.235538+0000","last_fullsized":"2026-02-20T11:36:10.235538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.238332+0000","last_change":"2026-02-20T11:35:59.060440+0000","last_active":"2026-02-20T11:36:11.238332+0000","last_peered":"2026-02-20T11:36:11.238332+0000","last_clean":"2026-02-20T11:36:11.238332+0000","last_became_active":"2026-02-20T11:35:59.043888+0000","last_became_peered":"2026-02-20T11:35:59.043888+0000","last_unstale":"2026-02-20T11:36:11.238332+0000","last_undegraded":"2026-02-20T11:36:11.238332+0000","last_fullsized":"2026-02-20T11:36:11.238332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"22'12","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.248320+0000","last_change":"2026-02-20T11:36:11.242618+0000","last_active":"2026-02-20T11:36:11.248320+0000","last_peered":"2026-02-20T11:36:11.248320+0000","last_clean":"2026-02-20T11:36:11.248320+0000","last_became_active":"2026-02-20T11:36:06.275765+0000","last_became_peered":"2026-02-20T11:36:06.275765+0000","last_unstale":"2026-02-20T11:36:11.248320+0000","last_undegraded":"2026-02-20T11:36:11.248320+0000","last_fullsized":"2026-02-20T11:36:11.248320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8184910,"num_objects":4,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":16,"num_write_kb":4851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:36:06.285894+0000","last_change":"2026-02-20T11:36:06.286396+0000","last_active":"2026-02-20T11:36:06.285894+0000","last_peered":"2026-02-20T11:36:06.285894+0000","last_clean":"2026-02-20T11:36:05.201041+0000","last_became_active":"2026-02-20T11:36:06.272226+0000","last_became_peered":"2026-02-20T11:36:06.272226+0000","last_unstale":"2026-02-20T11:36:06.285894+0000","last_undegraded":"2026-02-20T11:36:06.285894+0000","last_fullsized":"2026-02-20T11:36:06.285894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":34,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:36:10.237448+0000","last_change":"2026-02-20T11:36:01.022149+0000","last_active":"2026-02-20T11:36:10.237448+0000","last_peered":"2026-02-20T11:36:10.237448+0000","last_clean":"2026-02-20T11:36:10.237448+0000","last_became_active":"2026-02-20T11:35:59.065276+0000","last_became_peered":"2026-02-20T11:35:59.065276+0000","last_unstale":"2026-02-20T11:36:10.237448+0000","last_undegraded":"2026-02-20T11:36:10.237448+0000","last_fullsized":"2026-02-20T11:36:10.237448+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'14","reported_seq":42,"reported_epoch":22,"state":"active+clean+snaptrim","last_fresh":"2026-02-20T11:36:11.242020+0000","last_change":"2026-02-20T11:36:11.241946+0000","last_active":"2026-02-20T11:36:11.242020+0000","last_peered":"2026-02-20T11:36:11.242020+0000","last_clean":"2026-02-20T11:36:11.242020+0000","last_became_active":"2026-02-20T11:36:06.279191+0000","last_became_peered":"2026-02-20T11:36:06.279191+0000","last_unstale":"2026-02-20T11:36:11.242020+0000","last_undegraded":"2026-02-20T11:36:11.242020+0000","last_fullsized":"2026-02-20T11:36:11.242020+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5159683,"num_objects":4,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":8,"num_read_kb":4,"num_write":17,"num_write_kb":4308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:36:06.221178+0000","last_change":"2026-02-20T11:36:01.023609+0000","last_active":"2026-02-20T11:36:06.221178+0000","last_peered":"2026-02-20T11:36:06.221178+0000","last_clean":"2026-02-20T11:36:06.221178+0000","last_became_active":"2026-02-20T11:35:59.044553+0000","last_became_peered":"2026-02-20T11:35:59.044553+0000","last_unstale":"2026-02-20T11:36:06.221178+0000","last_undegraded":"2026-02-20T11:36:06.221178+0000","last_fullsized":"2026-02-20T11:36:06.221178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:36:06.286540+0000","last_change":"2026-02-20T11:36:06.287353+0000","last_active":"2026-02-20T11:36:06.286540+0000","last_peered":"2026-02-20T11:36:06.286540+0000","last_clean":"2026-02-20T11:36:05.201041+0000","last_became_active":"2026-02-20T11:36:06.264041+0000","last_became_peered":"2026-02-20T11:36:06.264041+0000","last_unstale":"2026-02-20T11:36:06.286540+0000","last_undegraded":"2026-02-20T11:36:06.286540+0000","last_fullsized":"2026-02-20T11:36:06.286540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.240724+0000","last_change":"2026-02-20T11:36:01.025173+0000","last_active":"2026-02-20T11:36:11.240724+0000","last_peered":"2026-02-20T11:36:11.240724+0000","last_clean":"2026-02-20T11:36:11.240724+0000","last_became_active":"2026-02-20T11:35:59.055623+0000","last_became_peered":"2026-02-20T11:35:59.055623+0000","last_unstale":"2026-02-20T11:36:11.240724+0000","last_undegraded":"2026-02-20T11:36:11.240724+0000","last_fullsized":"2026-02-20T11:36:11.240724+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-20T11:36:06.296444+0000","last_change":"2026-02-20T11:36:06.297343+0000","last_active":"2026-02-20T11:36:06.296444+0000","last_peered":"2026-02-20T11:36:06.296444+0000","last_clean":"2026-02-20T11:36:05.201041+0000","last_became_active":"2026-02-20T11:36:06.275865+0000","last_became_peered":"2026-02-20T11:36:06.275865+0000","last_unstale":"2026-02-20T11:36:06.296444+0000","last_undegraded":"2026-02-20T11:36:06.296444+0000","last_fullsized":"2026-02-20T11:36:06.296444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:36:05.201041+0000","last_clean_scrub_stamp":"2026-02-20T11:36:05.201041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:36:11.241044+0000","last_change":"2026-02-20T11:36:01.025256+0000","last_active":"2026-02-20T11:36:11.241044+0000","last_peered":"2026-02-20T11:36:11.241044+0000","last_clean":"2026-02-20T11:36:11.241044+0000","last_became_active":"2026-02-20T11:35:59.082337+0000","last_became_peered":"2026-02-20T11:35:59.082337+0000","last_unstale":"2026-02-20T11:36:11.241044+0000","last_undegraded":"2026-02-20T11:36:11.241044+0000","last_fullsized":"2026-02-20T11:36:11.241044+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:57.997336+0000","last_clean_scrub_stamp":"2026-02-20T11:35:57.997336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":86924649,"num_objects":40,"num_object_clones":4,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":1,"num_read":130,"num_read_kb":39057,"num_write":178,"num_write_kb":48393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":213674622976,"available":213525839872,"internally_reserved":0,"allocated":148783104,"data_stored":148783104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53418655744,"available":53360357376,"internally_reserved":0,"allocated":58298368,"data_stored":58298368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160255967232,"available":160146472960,"internally_reserved":0,"allocated":109494272,"data_stored":109494272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640270,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":55004,"kb_used_data":55004,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52111652,"statfs":{"total":53418655744,"available":53362331648,"internally_reserved":0,"allocated":56324096,"data_stored":56324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640265,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":704,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52165952,"statfs":{"total":53418655744,"available":53417934848,"internally_reserved":0,"allocated":720896,"data_stored":720896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":48924,"kb_used_data":48924,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52117732,"statfs":{"total":53418655744,"available":53368557568,"internally_reserved":0,"allocated":50098176,"data_stored":50098176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640270,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52166656,"kb_used":35592,"kb_used_data":35592,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52131064,"statfs":{"total":53418655744,"available":53382209536,"internally_reserved":0,"allocated":36446208,"data_stored":36446208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53418655744,"available":53368418304,"internally_reserved":0,"allocated":50237440,"data_stored":50237440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53418655744,"available":53417697280,"internally_reserved":0,"allocated":958464,"data_stored":958464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53418655744,"available":53360357376,"internally_reserved":0,"allocated":58298368,"data_stored":58298368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53418655744,"available":53360357376,"internally_reserved":0,"allocated":58298368,"data_stored":58298368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53418655744,"available":53379366912,"internally_reserved":0,"allocated":39288832,"data_stored":39288832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53418655744,"available":53368418304,"internally_reserved":0,"allocated":50237440,"data_stored":50237440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53418655744,"available":53417697280,"internally_reserved":0,"allocated":958464,"data_stored":958464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53418655744,"available":53360357376,"internally_reserved":0,"allocated":58298368,"data_stored":58298368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:36:19.650 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [0, 1, 3] 2026-02-20T11:36:19.650 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:36:19.651 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 3] 2026-02-20T11:36:19.651 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T11:36:19.651 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:36:19.709 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T11:36:24.710 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2, 0] live_osds: [1, 3] 2026-02-20T11:36:24.710 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:36:24.710 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2026-02-20T11:36:24.710 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T11:36:24.710 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T11:36:24.713 INFO:tasks.ceph.osd.2:Started 2026-02-20T11:36:24.713 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:24.785 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:24.788 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:24.788 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:29.059 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-20T11:36:29.789 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:29.861 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:29.863 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:29.864 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:34.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2026-02-20T11:36:34.864 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:34.936 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:34.939 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:34.939 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:38.769 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:38.799 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:38.800 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:39.825 INFO:tasks.rados.rados.0.trial046.stdout:67: finishing write tid 1 to trial04641590-45 2026-02-20T11:36:39.826 INFO:tasks.rados.rados.0.trial046.stdout:67: finishing write tid 2 to trial04641590-45 2026-02-20T11:36:39.826 INFO:tasks.rados.rados.0.trial046.stdout:67: finishing write tid 3 to trial04641590-45 2026-02-20T11:36:39.827 INFO:tasks.rados.rados.0.trial046.stdout:67: finishing write tid 4 to trial04641590-45 2026-02-20T11:36:39.829 INFO:tasks.rados.rados.0.trial046.stdout:74: finishing write tid 1 to trial04641590-8 2026-02-20T11:36:39.831 INFO:tasks.rados.rados.0.trial046.stdout:67: finishing write tid 5 to trial04641590-45 2026-02-20T11:36:39.831 INFO:tasks.rados.rados.0.trial046.stdout:67: oid 45 updating version 0 to 15 2026-02-20T11:36:39.831 INFO:tasks.rados.rados.0.trial046.stdout:67: oid 45 updating version 15 to 16 2026-02-20T11:36:39.831 INFO:tasks.rados.rados.0.trial046.stdout:67: oid 45 version 16 is already newer than 14 2026-02-20T11:36:39.831 INFO:tasks.rados.rados.0.trial046.stdout:67: oid 45 updating version 16 to 17 2026-02-20T11:36:39.831 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 45 v 17 (ObjNum 56 snap 1 seq_num 56) dirty exists 2026-02-20T11:36:39.831 INFO:tasks.rados.rados.0.trial046.stdout:67: left oid 45 (ObjNum 56 snap 1 seq_num 56) 2026-02-20T11:36:39.834 INFO:tasks.rados.rados.0.trial046.stdout:67: done (7 left) 2026-02-20T11:36:39.834 INFO:tasks.rados.rados.0.trial046.stdout:82: done (6 left) 2026-02-20T11:36:39.835 INFO:tasks.rados.rados.0.trial046.stdout:83: write (excl) oid 37 current snap is 3 2026-02-20T11:36:39.835 INFO:tasks.rados.rados.0.trial046.stdout:83: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2026-02-20T11:36:39.840 INFO:tasks.rados.rados.0.trial046.stdout:83: writing trial04641590-37 from 709262 to 1406520 tid 1 2026-02-20T11:36:39.845 INFO:tasks.rados.rados.0.trial046.stdout:83: writing trial04641590-37 from 2012635 to 2584653 tid 2 2026-02-20T11:36:39.847 INFO:tasks.rados.rados.0.trial046.stdout:83: writing trial04641590-37 from 3046388 to 3109262 tid 3 2026-02-20T11:36:39.847 INFO:tasks.rados.rados.0.trial046.stdout:84: write oid 34 current snap is 3 2026-02-20T11:36:39.847 INFO:tasks.rados.rados.0.trial046.stdout:84: seq_num 67 ranges {726069=772507,2071117=715676} 2026-02-20T11:36:39.853 INFO:tasks.rados.rados.0.trial046.stdout:84: writing trial04641590-34 from 726069 to 1498576 tid 1 2026-02-20T11:36:39.858 INFO:tasks.rados.rados.0.trial046.stdout:84: writing trial04641590-34 from 2071117 to 2786793 tid 2 2026-02-20T11:36:39.858 INFO:tasks.rados.rados.0.trial046.stdout:85: read oid 5 snap -1 2026-02-20T11:36:39.858 INFO:tasks.rados.rados.0.trial046.stdout:85: expect (ObjNum 4 snap 0 seq_num 4) 2026-02-20T11:36:39.858 INFO:tasks.rados.rados.0.trial046.stdout:86: read oid 32 snap -1 2026-02-20T11:36:39.859 INFO:tasks.rados.rados.0.trial046.stdout:86: expect (ObjNum 60 snap 2 seq_num 60) 2026-02-20T11:36:39.859 INFO:tasks.rados.rados.0.trial046.stdout:87: write oid 10 current snap is 3 2026-02-20T11:36:39.859 INFO:tasks.rados.rados.0.trial046.stdout:87: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2026-02-20T11:36:39.862 INFO:tasks.rados.rados.0.trial046.stdout:87: writing trial04641590-10 from 742876 to 1190632 tid 1 2026-02-20T11:36:39.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~11s 2026-02-20T11:36:39.866 INFO:tasks.rados.rados.0.trial046.stdout:87: writing trial04641590-10 from 1729599 to 2305286 tid 2 2026-02-20T11:36:39.870 INFO:tasks.rados.rados.0.trial046.stdout:87: writing trial04641590-10 from 3101234 to 3142876 tid 3 2026-02-20T11:36:39.870 INFO:tasks.rados.rados.0.trial046.stdout:88: snap_remove snap 2 2026-02-20T11:36:39.940 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:40.011 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:40.014 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:40.015 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:40.778 INFO:tasks.rados.rados.0.trial046.stdout:88: done (11 left) 2026-02-20T11:36:40.779 INFO:tasks.rados.rados.0.trial046.stdout:89: write oid 19 current snap is 3 2026-02-20T11:36:40.779 INFO:tasks.rados.rados.0.trial046.stdout:89: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2026-02-20T11:36:40.783 INFO:tasks.rados.rados.0.trial046.stdout:89: writing trial04641590-19 from 759683 to 1399041 tid 1 2026-02-20T11:36:40.788 INFO:tasks.rados.rados.0.trial046.stdout:89: writing trial04641590-19 from 1904434 to 2623779 tid 2 2026-02-20T11:36:40.790 INFO:tasks.rados.rados.0.trial046.stdout:89: writing trial04641590-19 from 3128657 to 3159683 tid 3 2026-02-20T11:36:40.790 INFO:tasks.rados.rados.0.trial046.stdout:90: read oid 12 snap -1 2026-02-20T11:36:40.791 INFO:tasks.rados.rados.0.trial046.stdout:90: expect deleted 2026-02-20T11:36:40.791 INFO:tasks.rados.rados.0.trial046.stdout:91: write (excl) oid 36 current snap is 3 2026-02-20T11:36:40.791 INFO:tasks.rados.rados.0.trial046.stdout:91: seq_num 70 ranges {776490=714607,2246563=579356} 2026-02-20T11:36:40.796 INFO:tasks.rados.rados.0.trial046.stdout:91: writing trial04641590-36 from 776490 to 1491097 tid 1 2026-02-20T11:36:40.801 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:40.802 INFO:tasks.rados.rados.0.trial046.stdout:91: writing trial04641590-36 from 2246563 to 2825919 tid 2 2026-02-20T11:36:40.802 INFO:tasks.rados.rados.0.trial046.stdout:92: read oid 13 snap -1 2026-02-20T11:36:40.802 INFO:tasks.rados.rados.0.trial046.stdout:92: expect (ObjNum 12 snap 0 seq_num 12) 2026-02-20T11:36:40.802 INFO:tasks.rados.rados.0.trial046.stdout:93: delete oid 44 current snap is 3 2026-02-20T11:36:40.802 INFO:tasks.rados.rados.0.trial046.stdout:86: expect (ObjNum 60 snap 2 seq_num 60) 2026-02-20T11:36:40.846 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 1135071 2026-02-20T11:36:40.881 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:40.878+0000 7f39db65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:40.883 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 2027475 2026-02-20T11:36:40.884 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:40.881+0000 7f39db65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:40.894 INFO:tasks.rados.rados.0.trial046.stdout:74: finishing write tid 2 to trial04641590-8 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:74: finishing write tid 3 to trial04641590-8 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:74: finishing write tid 4 to trial04641590-8 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:86: done (15 left) 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:93: done (14 left) 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:94: write (excl) oid 41 current snap is 3 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:74: finishing write tid 5 to trial04641590-8 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:74: oid 8 updating version 0 to 32 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:74: oid 8 updating version 32 to 35 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:74: oid 8 version 35 is already newer than 35 2026-02-20T11:36:40.895 INFO:tasks.rados.rados.0.trial046.stdout:74: oid 8 version 35 is already newer than 35 2026-02-20T11:36:40.896 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 8 v 35 (ObjNum 59 snap 2 seq_num 59) dirty exists 2026-02-20T11:36:40.896 INFO:tasks.rados.rados.0.trial046.stdout:74: left oid 8 (ObjNum 59 snap 2 seq_num 59) 2026-02-20T11:36:40.896 INFO:tasks.rados.rados.0.trial046.stdout:85: expect (ObjNum 4 snap 0 seq_num 4) 2026-02-20T11:36:40.906 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 282814 2026-02-20T11:36:40.922 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 0 2026-02-20T11:36:40.939 INFO:tasks.rados.rados.0.trial046.stdout:81: finishing write tid 1 to trial04641590-48 2026-02-20T11:36:40.940 INFO:tasks.rados.rados.0.trial046.stdout:94: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2026-02-20T11:36:40.943 INFO:tasks.rados.rados.0.trial046.stdout:94: writing trial04641590-41 from 410104 to 875209 tid 1 2026-02-20T11:36:40.948 INFO:tasks.rados.rados.0.trial046.stdout:94: writing trial04641590-41 from 1563527 to 2146552 tid 2 2026-02-20T11:36:40.953 INFO:tasks.rados.rados.0.trial046.stdout:94: writing trial04641590-41 from 2810926 to 3210104 tid 3 2026-02-20T11:36:40.953 INFO:tasks.rados.rados.0.trial046.stdout:74: done (14 left) 2026-02-20T11:36:40.953 INFO:tasks.rados.rados.0.trial046.stdout:85: done (13 left) 2026-02-20T11:36:40.953 INFO:tasks.rados.rados.0.trial046.stdout:95: write oid 33 current snap is 3 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:81: finishing write tid 2 to trial04641590-48 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:81: finishing write tid 3 to trial04641590-48 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:81: finishing write tid 4 to trial04641590-48 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:81: oid 48 updating version 0 to 39 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:81: oid 48 version 39 is already newer than 39 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:81: oid 48 version 39 is already newer than 39 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 48 v 39 (ObjNum 64 snap 3 seq_num 64) dirty exists 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:81: left oid 48 (ObjNum 64 snap 3 seq_num 64) 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:87: finishing write tid 1 to trial04641590-10 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:87: finishing write tid 2 to trial04641590-10 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:87: finishing write tid 3 to trial04641590-10 2026-02-20T11:36:40.954 INFO:tasks.rados.rados.0.trial046.stdout:87: finishing write tid 4 to trial04641590-10 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:87: finishing write tid 5 to trial04641590-10 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:87: oid 10 updating version 0 to 44 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:87: oid 10 version 44 is already newer than 44 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:87: oid 10 version 44 is already newer than 44 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:87: oid 10 version 44 is already newer than 44 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 10 v 44 (ObjNum 68 snap 3 seq_num 68) dirty exists 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:87: left oid 10 (ObjNum 68 snap 3 seq_num 68) 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:83: finishing write tid 1 to trial04641590-37 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:83: finishing write tid 2 to trial04641590-37 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:83: finishing write tid 3 to trial04641590-37 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:83: finishing write tid 4 to trial04641590-37 2026-02-20T11:36:40.955 INFO:tasks.rados.rados.0.trial046.stdout:83: finishing write tid 5 to trial04641590-37 2026-02-20T11:36:40.956 INFO:tasks.rados.rados.0.trial046.stdout:83: oid 37 updating version 0 to 23 2026-02-20T11:36:40.956 INFO:tasks.rados.rados.0.trial046.stdout:83: oid 37 version 23 is already newer than 20 2026-02-20T11:36:40.956 INFO:tasks.rados.rados.0.trial046.stdout:83: oid 37 version 23 is already newer than 23 2026-02-20T11:36:40.956 INFO:tasks.rados.rados.0.trial046.stdout:83: oid 37 version 23 is already newer than 23 2026-02-20T11:36:40.956 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 37 v 23 (ObjNum 66 snap 3 seq_num 66) dirty exists 2026-02-20T11:36:40.956 INFO:tasks.rados.rados.0.trial046.stdout:83: left oid 37 (ObjNum 66 snap 3 seq_num 66) 2026-02-20T11:36:40.956 INFO:tasks.rados.rados.0.trial046.stdout:95: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2026-02-20T11:36:40.957 INFO:tasks.rados.rados.0.trial046.stdout:95: writing trial04641590-33 from 426911 to 967265 tid 1 2026-02-20T11:36:40.960 INFO:tasks.rados.rados.0.trial046.stdout:95: writing trial04641590-33 from 1622009 to 2348692 tid 2 2026-02-20T11:36:40.964 INFO:tasks.rados.rados.0.trial046.stdout:95: writing trial04641590-33 from 3121996 to 3226911 tid 3 2026-02-20T11:36:40.964 INFO:tasks.rados.rados.0.trial046.stdout:81: done (13 left) 2026-02-20T11:36:40.964 INFO:tasks.rados.rados.0.trial046.stdout:83: done (12 left) 2026-02-20T11:36:40.965 INFO:tasks.rados.rados.0.trial046.stdout:87: done (11 left) 2026-02-20T11:36:40.965 INFO:tasks.rados.rados.0.trial046.stdout:96: delete oid 17 current snap is 3 2026-02-20T11:36:40.965 INFO:tasks.rados.rados.0.trial046.stdout:89: finishing write tid 1 to trial04641590-19 2026-02-20T11:36:40.965 INFO:tasks.rados.rados.0.trial046.stdout:91: finishing write tid 1 to trial04641590-36 2026-02-20T11:36:40.965 INFO:tasks.rados.rados.0.trial046.stdout:92: expect (ObjNum 12 snap 0 seq_num 12) 2026-02-20T11:36:40.989 INFO:tasks.rados.rados.0.trial046.stdout:seeking to 2064844 2026-02-20T11:36:41.005 INFO:tasks.rados.rados.0.trial046.stdout:89: finishing write tid 2 to trial04641590-19 2026-02-20T11:36:41.005 INFO:tasks.rados.rados.0.trial046.stdout:89: finishing write tid 3 to trial04641590-19 2026-02-20T11:36:41.005 INFO:tasks.rados.rados.0.trial046.stdout:89: finishing write tid 4 to trial04641590-19 2026-02-20T11:36:41.005 INFO:tasks.rados.rados.0.trial046.stdout:91: finishing write tid 2 to trial04641590-36 2026-02-20T11:36:41.005 INFO:tasks.rados.rados.0.trial046.stdout:89: finishing write tid 5 to trial04641590-19 2026-02-20T11:36:41.005 INFO:tasks.rados.rados.0.trial046.stdout:89: oid 19 updating version 0 to 27 2026-02-20T11:36:41.005 INFO:tasks.rados.rados.0.trial046.stdout:89: oid 19 version 27 is already newer than 27 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:89: oid 19 version 27 is already newer than 27 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:89: oid 19 version 27 is already newer than 27 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 19 v 27 (ObjNum 69 snap 3 seq_num 69) dirty exists 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:89: left oid 19 (ObjNum 69 snap 3 seq_num 69) 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:91: finishing write tid 3 to trial04641590-36 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:91: finishing write tid 4 to trial04641590-36 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:91: oid 36 updating version 0 to 6 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:91: oid 36 version 6 is already newer than 4 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:91: oid 36 version 6 is already newer than 6 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 36 v 6 (ObjNum 70 snap 3 seq_num 70) dirty exists 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:91: left oid 36 (ObjNum 70 snap 3 seq_num 70) 2026-02-20T11:36:41.006 INFO:tasks.rados.rados.0.trial046.stdout:95: finishing write tid 1 to trial04641590-33 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:95: finishing write tid 2 to trial04641590-33 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:95: finishing write tid 3 to trial04641590-33 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:95: finishing write tid 4 to trial04641590-33 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:95: finishing write tid 5 to trial04641590-33 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:95: oid 33 updating version 0 to 31 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:95: oid 33 version 31 is already newer than 31 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:95: oid 33 version 31 is already newer than 31 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:95: oid 33 version 31 is already newer than 31 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:update_object_version oid 33 v 31 (ObjNum 73 snap 3 seq_num 73) dirty exists 2026-02-20T11:36:41.007 INFO:tasks.rados.rados.0.trial046.stdout:95: left oid 33 (ObjNum 73 snap 3 seq_num 73) 2026-02-20T11:36:45.016 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:45.088 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:45.091 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:45.091 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:45.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~16s 2026-02-20T11:36:49.045 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:36:49.078 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:49.099 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:49.099 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:50.093 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:50.098 INFO:tasks.rados.rados.0.trial046.stdout:89: done (11 left) 2026-02-20T11:36:50.098 INFO:tasks.rados.rados.0.trial046.stdout:90: done (10 left) 2026-02-20T11:36:50.098 INFO:tasks.rados.rados.0.trial046.stdout:91: done (9 left) 2026-02-20T11:36:50.098 INFO:tasks.rados.rados.0.trial046.stdout:92: done (8 left) 2026-02-20T11:36:50.098 INFO:tasks.rados.rados.0.trial046.stdout:95: done (7 left) 2026-02-20T11:36:50.098 INFO:tasks.rados.rados.0.trial046.stdout:96: done (6 left) 2026-02-20T11:36:50.098 INFO:tasks.rados.rados.0.trial046.stdout:97: snap_create 2026-02-20T11:36:50.166 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:50.169 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:50.169 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:50.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~22s 2026-02-20T11:36:51.054 INFO:tasks.rados.rados.0.trial046.stdout:97: done (6 left) 2026-02-20T11:36:51.054 INFO:tasks.rados.rados.0.trial046.stdout:98: delete oid 49 current snap is 4 2026-02-20T11:36:51.100 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:51.179 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:51.176+0000 7f19b2974640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:51.181 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:51.179+0000 7f19b2974640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:51.184 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:36:51.197 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:51.211 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:51.212 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:53.212 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:53.291 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:53.287+0000 7f6e2facb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:53.293 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:53.291+0000 7f6e2facb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:53.297 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:36:53.309 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:53.324 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:53.325 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:55.171 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:55.243 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:55.246 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:55.246 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:55.326 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:55.404 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:55.401+0000 7f044ddad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:55.406 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:55.404+0000 7f044ddad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:55.410 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:36:55.423 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:55.441 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:55.442 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:56.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~27s 2026-02-20T11:36:57.443 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:57.521 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:57.519+0000 7f017f18c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:57.524 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:57.522+0000 7f017f18c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:57.527 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:36:57.540 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:57.555 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:57.556 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:59.557 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:59.634 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:59.632+0000 7f3b88e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:59.636 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:36:59.635+0000 7f3b88e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:59.640 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:36:59.651 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:59.668 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:59.669 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:00.247 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:00.319 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:00.321 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:00.322 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:01.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~32s 2026-02-20T11:37:01.670 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:01.746 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:01.744+0000 7fd3d690b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:01.748 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:01.747+0000 7fd3d690b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:01.752 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:01.764 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:01.780 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:01.781 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:03.782 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:03.861 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:03.858+0000 7f39c02cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:03.863 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:03.862+0000 7f39c02cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:03.866 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:03.878 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:03.895 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:03.895 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:05.323 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:05.396 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:05.399 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:05.400 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:05.896 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:05.973 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:05.971+0000 7f44b270b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:05.976 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:05.975+0000 7f44b270b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:05.979 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:05.991 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:06.007 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:06.008 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:06.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~38s 2026-02-20T11:37:08.009 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:08.088 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:08.085+0000 7f7057a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:08.090 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:08.089+0000 7f7057a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:08.093 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:08.105 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:08.121 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:08.122 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:10.123 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:10.201 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:10.199+0000 7f53e32cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:10.204 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:10.202+0000 7f53e32cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:10.207 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:10.218 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:10.233 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:10.233 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:10.400 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:10.474 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:10.477 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:10.477 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:12.234 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:12.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~43s 2026-02-20T11:37:12.313 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:12.310+0000 7f97dd25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:12.315 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:12.314+0000 7f97dd25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:12.318 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:12.332 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:12.348 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:12.348 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:14.349 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:14.426 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:14.424+0000 7f86a8235640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:14.429 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:14.428+0000 7f86a8235640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:14.432 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:14.444 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:14.460 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:14.461 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:15.479 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:15.550 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:15.553 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:15.554 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:16.462 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:16.538 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:16.536+0000 7f1fb7c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:16.540 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:16.539+0000 7f1fb7c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:16.544 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:16.556 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:16.573 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:16.573 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:17.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~49s 2026-02-20T11:37:18.574 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:18.651 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:18.649+0000 7f7f54ab7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:18.653 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:18.652+0000 7f7f54ab7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:18.656 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:18.668 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:18.682 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:18.683 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:20.555 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:20.628 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:20.631 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:20.631 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:20.684 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:20.762 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:20.760+0000 7ff74785a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:20.764 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:20.764+0000 7ff74785a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:20.768 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:20.780 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:20.795 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:20.795 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:22.796 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:22.875 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:22.873+0000 7f6e34a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:22.877 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:22.876+0000 7f6e34a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:22.880 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:22.892 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:22.908 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:22.908 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:23.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~54s 2026-02-20T11:37:24.909 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:24.986 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:24.982+0000 7fd82e03d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:24.988 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:24.986+0000 7fd82e03d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:24.992 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:25.003 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:25.017 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:25.018 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:25.632 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:25.707 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:25.710 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:25.711 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:27.019 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:27.095 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:27.092+0000 7fde2cfad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:27.098 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:27.096+0000 7fde2cfad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:27.101 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:27.113 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:27.129 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:27.130 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:28.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2026-02-20T11:37:29.131 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:29.208 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:29.205+0000 7f92039b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:29.210 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:29.208+0000 7f92039b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:29.213 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:29.227 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:29.243 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:29.243 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:30.712 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:30.784 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:30.787 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:30.788 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:31.244 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:31.323 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:31.319+0000 7f040538c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:31.325 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:31.323+0000 7f040538c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:31.329 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:31.342 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:31.357 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:31.358 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:33.359 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:33.436 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:33.433+0000 7ff2344cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:33.439 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:33.436+0000 7ff2344cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:33.442 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:33.454 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:33.468 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:33.468 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:33.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2026-02-20T11:37:35.469 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:35.548 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:35.545+0000 7f9e6c65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:35.550 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:35.548+0000 7f9e6c65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:35.554 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:35.565 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:35.579 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:35.580 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:35.789 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:35.862 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:35.864 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:35.865 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:37.581 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:37.658 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:37.655+0000 7f55ce61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:37.661 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:37.658+0000 7f55ce61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:37.664 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:37.676 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:37.693 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:37.693 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:39.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2026-02-20T11:37:39.694 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:39.770 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:39.766+0000 7f64ff1cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:39.772 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:39.770+0000 7f64ff1cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:39.777 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:39.789 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:39.804 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:39.804 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:40.866 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:40.939 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:40.942 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:40.942 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:41.805 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:41.883 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:41.879+0000 7f63330cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:41.885 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:41.883+0000 7f63330cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:41.889 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:41.901 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:41.918 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:41.919 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:43.920 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:43.998 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:43.994+0000 7fa8fd85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:44.000 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:43.998+0000 7fa8fd85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:44.004 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:44.016 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:44.032 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:44.032 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:44.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2026-02-20T11:37:45.944 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:46.015 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:46.018 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:46.019 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:46.033 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:46.112 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:46.109+0000 7f741b3f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.114 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:46.113+0000 7f741b3f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.118 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:46.129 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:46.144 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:46.145 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:48.146 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:48.223 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:48.220+0000 7f9bf5eb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.225 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:48.224+0000 7f9bf5eb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.228 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:48.240 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:48.255 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:48.256 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:50.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~81s 2026-02-20T11:37:50.257 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:50.334 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:50.332+0000 7fa591651640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.337 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:50.335+0000 7fa591651640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.340 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:50.351 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:50.368 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:50.368 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:51.019 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:51.091 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:51.094 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:51.094 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:52.370 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:52.445 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:52.443+0000 7f548c5b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:52.448 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:52.447+0000 7f548c5b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:52.451 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:52.463 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:52.478 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:52.478 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:54.480 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:54.556 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:54.554+0000 7f91923ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:54.559 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:54.558+0000 7f91923ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:54.563 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:54.575 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:54.591 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:54.591 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:55.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~86s 2026-02-20T11:37:56.095 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:56.166 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:56.169 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:56.169 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:56.593 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:56.670 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:56.668+0000 7fc20c9a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:56.672 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:56.671+0000 7fc20c9a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:56.676 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:56.687 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:56.704 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:56.704 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:58.705 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:58.783 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:58.781+0000 7f9f37acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:58.786 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:37:58.785+0000 7f9f37acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:58.789 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:37:58.801 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:58.816 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:58.817 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:00.818 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:00.894 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:00.892+0000 7f9c2d4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:00.896 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:00.895+0000 7f9c2d4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:00.900 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:00.912 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:00.922 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~92s 2026-02-20T11:38:00.928 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:00.928 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:01.171 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:01.242 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:01.245 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:01.246 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:02.929 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:03.006 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:03.004+0000 7f61c8d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:03.009 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:03.008+0000 7f61c8d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:03.013 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:03.024 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:03.041 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:03.041 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:05.042 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:05.118 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:05.116+0000 7f7db1e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:05.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:05.120+0000 7f7db1e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:05.124 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:05.136 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:05.152 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:05.152 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:06.247 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:06.319 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:06.322 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:06.322 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:06.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~97s 2026-02-20T11:38:07.154 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:07.232 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:07.230+0000 7f37cea3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:07.234 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:07.233+0000 7f37cea3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:07.238 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:07.250 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:07.264 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:07.265 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:09.266 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:09.344 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:09.342+0000 7ff6bf1fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:09.347 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:09.345+0000 7ff6bdf74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:09.350 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:09.362 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:09.378 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:09.379 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:11.323 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:11.380 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:11.394 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:11.397 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:11.397 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:11.458 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:11.455+0000 7f2b6a8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:11.460 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:11.458+0000 7f2b6a8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:11.464 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:11.475 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:11.493 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:11.493 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:11.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~103s 2026-02-20T11:38:13.494 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:13.570 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:13.567+0000 7fb7baccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:13.572 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:13.570+0000 7fb7baccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:13.576 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:13.588 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:13.603 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:13.603 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:15.604 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:15.681 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:15.678+0000 7f8688c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:15.683 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:15.681+0000 7f8688c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:15.686 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:15.698 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:15.713 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:15.714 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:16.399 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:16.470 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:16.473 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:16.473 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:17.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~108s 2026-02-20T11:38:17.715 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:17.791 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:17.788+0000 7f1b42f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:17.794 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:17.792+0000 7f1b41c82640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:17.797 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:17.809 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:17.825 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:17.825 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:19.827 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:19.903 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:19.900+0000 7f34a27cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:19.905 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:19.903+0000 7f34a27cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:19.909 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:19.920 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:19.934 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:19.935 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:21.474 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:21.546 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:21.549 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:21.549 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:21.936 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:22.014 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:22.011+0000 7f95497f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:22.016 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:22.014+0000 7f95497f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:22.020 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:22.032 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:22.047 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:22.048 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:22.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~113s 2026-02-20T11:38:24.050 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:24.128 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:24.124+0000 7f585301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:24.130 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:24.128+0000 7f585301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:24.133 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:24.146 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:24.161 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:24.162 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:26.163 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:26.239 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:26.236+0000 7f64dd05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:26.241 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:26.239+0000 7f64dd05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:26.244 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:26.256 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:26.272 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:26.273 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:26.550 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:26.622 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:26.624 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:26.625 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:27.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~119s 2026-02-20T11:38:28.273 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:28.351 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:28.348+0000 7f94c1206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:28.353 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:28.351+0000 7f94c1206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:28.357 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:28.368 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:28.382 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:28.383 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:30.384 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:30.461 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:30.458+0000 7f85d9235640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:30.463 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:30.461+0000 7f85d9235640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:30.467 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:30.479 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:30.494 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:30.495 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:31.625 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:31.696 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:31.698 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:31.699 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:32.496 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:32.574 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:32.571+0000 7f66f6fa4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:32.576 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:32.575+0000 7f66f6fa4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:32.580 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:32.592 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:32.608 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:32.608 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:33.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~124s 2026-02-20T11:38:34.609 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:34.687 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:34.684+0000 7f1f1fa46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:34.689 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:34.688+0000 7f1f1fa46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:34.692 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:34.704 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:34.719 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:34.720 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:36.701 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:36.721 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:36.773 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:36.776 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:36.776 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:36.799 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:36.797+0000 7fa24783d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:36.801 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:36.800+0000 7fa24783d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:36.804 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:36.816 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:36.832 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:36.832 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:38.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~130s 2026-02-20T11:38:38.834 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:38.910 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:38.907+0000 7f6370ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:38.912 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:38.911+0000 7f6370ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:38.915 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:38.927 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:38.941 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:38.942 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:40.943 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:41.021 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:41.019+0000 7fcde4a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:41.023 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:41.022+0000 7fcde4a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:41.027 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:41.038 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:41.054 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:41.055 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:41.777 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:41.849 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:41.851 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:41.852 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:43.056 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:43.134 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:43.131+0000 7f409da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:43.136 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:43.135+0000 7f409da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:43.139 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:43.151 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:43.166 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:43.167 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:44.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2026-02-20T11:38:45.167 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:45.243 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:45.241+0000 7f7a3870b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:45.245 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:45.244+0000 7f7a3870b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:45.249 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:45.263 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:45.279 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:45.279 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:46.852 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:46.923 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:46.926 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:46.927 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:47.281 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:47.358 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:47.355+0000 7f7bea61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:47.360 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:47.359+0000 7f7bea61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:47.364 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:47.376 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:47.391 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:47.392 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:49.393 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:49.471 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:49.468+0000 7ff29641a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:49.473 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:49.472+0000 7ff29641a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:49.477 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:49.488 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:49.504 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:49.505 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:49.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2026-02-20T11:38:51.506 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:51.584 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:51.581+0000 7fdb101d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:51.586 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:51.585+0000 7fdb0ef4a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:51.590 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:51.601 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:51.618 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:51.618 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:51.928 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:51.999 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:52.002 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:52.002 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:53.619 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:53.696 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:53.694+0000 7ff495d9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:53.698 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:53.697+0000 7ff495d9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:53.702 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:53.714 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:53.727 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:53.728 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:54.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~146s 2026-02-20T11:38:55.729 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:55.805 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:55.803+0000 7fd93825a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:55.808 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:55.807+0000 7fd93825a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:55.812 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:55.827 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:55.846 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:55.847 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:57.003 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:57.075 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:57.078 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:57.078 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:57.847 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:57.925 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:57.923+0000 7f87a363d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:57.928 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:38:57.926+0000 7f87a363d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:57.931 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:38:57.943 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:57.958 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:57.958 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:59.960 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:00.037 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:00.033+0000 7fcf43e35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.039 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:00.037+0000 7fcf43e35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.042 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:00.054 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:00.069 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:00.070 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:00.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~151s 2026-02-20T11:39:02.071 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:02.079 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:02.148 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:02.145+0000 7f99e701a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:02.150 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:02.148+0000 7f99e701a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:02.151 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:02.153 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:02.154 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:02.154 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:02.166 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:02.179 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:02.179 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:04.180 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:04.258 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:04.255+0000 7f194821a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:04.261 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:04.258+0000 7f194821a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:04.264 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:04.278 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:04.294 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:04.294 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:05.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~157s 2026-02-20T11:39:06.296 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:06.373 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:06.370+0000 7f779b2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:06.376 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:06.374+0000 7f779b2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:06.379 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:06.391 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:06.407 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:06.407 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:07.154 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:07.227 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:07.230 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:07.230 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:08.408 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:08.483 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:08.480+0000 7f217498c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:08.486 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:08.483+0000 7f217498c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:08.489 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:08.501 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:08.515 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:08.515 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:10.517 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:10.594 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:10.591+0000 7f97dafcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:10.596 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:10.594+0000 7f97dafcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:10.600 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:10.612 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:10.628 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:10.629 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:11.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~162s 2026-02-20T11:39:12.232 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:12.305 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:12.307 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:12.308 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:12.630 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:12.708 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:12.705+0000 7f17e47ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:12.711 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:12.708+0000 7f17e47ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:12.714 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:12.726 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:12.743 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:12.743 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:14.744 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:14.821 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:14.818+0000 7fca62ff5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:14.823 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:14.821+0000 7fca62ff5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:14.827 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:14.845 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:14.862 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:14.863 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:16.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~168s 2026-02-20T11:39:16.864 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:16.942 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:16.938+0000 7f0af430b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:16.944 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:16.942+0000 7f0af430b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:16.947 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:16.959 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:16.975 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:16.975 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:17.309 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:17.382 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:17.385 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:17.385 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:18.976 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:19.055 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:19.051+0000 7f7ae2962640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.057 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:19.055+0000 7f7ae2962640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:19.060 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:19.072 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:19.089 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:19.090 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:21.091 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:21.169 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:21.166+0000 7fd11585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:21.171 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:21.170+0000 7fd11585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:21.174 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:21.186 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:21.201 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:21.201 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:21.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~173s 2026-02-20T11:39:22.387 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:22.457 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:22.460 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:22.461 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:23.202 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:23.279 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:23.277+0000 7f4cd04c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:23.281 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:23.280+0000 7f4cd04c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:23.285 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:23.297 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:23.314 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:23.315 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:25.316 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:25.393 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:25.391+0000 7f184cd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:25.395 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:25.394+0000 7f184cd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:25.398 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:25.410 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:25.425 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:25.426 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:27.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~178s 2026-02-20T11:39:27.426 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:27.461 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:27.503 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:27.501+0000 7f01aefb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:27.505 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:27.504+0000 7f01aefb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:27.509 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:27.521 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:27.534 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:27.537 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:27.538 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:27.538 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:27.539 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:29.540 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:29.618 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:29.616+0000 7fee11c1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:29.620 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:29.619+0000 7fee11c1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:29.624 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:29.636 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:29.650 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:29.651 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:31.652 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:31.732 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:31.729+0000 7f6e6819c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:31.734 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:31.733+0000 7f6e6819c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:31.737 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:31.749 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:31.764 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:31.765 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:32.539 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:32.610 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:32.613 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:32.614 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:32.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~184s 2026-02-20T11:39:33.766 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:33.844 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:33.841+0000 7fe27af0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:33.846 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:33.844+0000 7fe27af0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:33.849 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:33.861 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:33.876 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:33.877 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:35.878 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:35.954 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:35.951+0000 7fe19470b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:35.956 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:35.955+0000 7fe19470b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:35.960 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:35.972 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:35.989 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:35.990 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:37.615 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:37.688 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:37.691 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:37.691 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:37.991 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:38.066 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:38.064+0000 7f53ff25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:38.069 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:38.067+0000 7f53ff25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:38.072 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:38.083 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:38.100 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:38.100 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:38.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~189s 2026-02-20T11:39:40.102 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:40.179 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:40.176+0000 7f4049ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:40.181 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:40.180+0000 7f4049ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:40.184 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:40.196 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:40.212 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:40.212 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:42.214 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:42.291 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:42.288+0000 7fd2ca851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:42.293 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:42.292+0000 7fd2ca851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:42.296 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:42.308 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:42.323 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:42.324 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:42.692 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:42.765 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:42.768 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:42.768 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:43.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~195s 2026-02-20T11:39:44.325 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:44.402 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:44.400+0000 7f3f7f7c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:44.404 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:44.403+0000 7f3f7f7c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:44.408 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:44.419 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:44.435 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:44.436 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:46.437 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:46.515 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:46.513+0000 7f5fd2035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:46.517 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:46.516+0000 7f5fd2035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:46.521 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:46.532 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:46.549 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:46.550 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:47.770 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:47.843 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:47.846 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:47.847 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:48.551 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:48.629 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:48.625+0000 7fc66895c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:48.631 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:48.629+0000 7fc66895c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:48.635 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:48.646 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:48.661 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:48.662 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:48.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~200s 2026-02-20T11:39:50.663 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:50.741 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:50.737+0000 7fbf3085a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:50.743 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:50.741+0000 7fbf3085a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:50.747 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:50.758 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:50.774 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:50.775 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:52.775 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:52.848 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:52.852 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:52.849+0000 7f1eb34b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:52.855 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:52.853+0000 7f1eb34b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:52.858 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:52.870 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:52.886 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:52.886 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:52.918 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:52.921 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:52.922 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:54.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2026-02-20T11:39:54.887 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:54.963 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:54.960+0000 7fbcf896f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:54.966 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:54.963+0000 7fbcf896f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:54.969 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:54.981 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:54.997 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:54.998 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:56.999 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:57.075 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:57.072+0000 7fe50e50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:57.078 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:57.075+0000 7fe50e50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:57.081 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:57.092 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:57.108 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:57.108 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:57.923 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:57.995 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:57.998 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:57.998 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:59.109 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:59.189 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:59.185+0000 7f92df25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:59.191 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:39:59.189+0000 7f92df25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:59.195 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:39:59.206 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:59.223 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:59.224 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:59.802 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~211s 2026-02-20T11:40:01.224 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:01.303 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:01.299+0000 7f7ca290b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:01.305 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:01.303+0000 7f7ca290b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:01.309 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:01.322 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:01.339 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:01.340 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:02.999 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:03.071 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:03.074 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:03.075 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:03.341 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:03.419 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:03.415+0000 7f6b95a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:03.422 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:03.419+0000 7f6b95a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:03.425 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:03.437 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:03.453 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:03.454 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:05.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~216s 2026-02-20T11:40:05.454 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:05.534 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:05.531+0000 7f97dd38c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:05.536 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:05.534+0000 7f97dd38c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:05.540 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:05.551 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:05.567 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:05.568 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:07.569 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:07.645 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:07.642+0000 7fd61695c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:07.648 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:07.646+0000 7fd61695c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:07.652 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:07.664 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:07.679 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:07.680 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:08.076 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:08.149 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:08.152 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:08.153 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:09.681 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:09.757 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:09.755+0000 7f3afbc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:09.759 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:09.758+0000 7f3afbc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:09.763 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:09.776 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:09.793 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:09.794 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:10.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~222s 2026-02-20T11:40:11.795 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:11.872 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:11.870+0000 7f319b0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:11.875 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:11.873+0000 7f319b0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:11.878 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:11.892 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:11.908 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:11.909 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:13.153 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:13.226 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:13.229 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:13.230 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:13.910 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:13.987 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:13.985+0000 7f9bc68cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:13.989 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:13.988+0000 7f9bc68cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:13.993 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:14.004 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:14.018 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:14.019 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:16.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~227s 2026-02-20T11:40:16.020 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:16.097 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:16.095+0000 7f66426cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:16.100 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:16.099+0000 7f66426cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:16.103 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:16.115 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:16.129 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:16.130 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:18.131 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:18.206 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:18.204+0000 7ff86936f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.208 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:18.207+0000 7ff86936f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.211 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:18.223 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:18.230 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:18.238 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:18.239 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:18.302 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:18.305 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:18.306 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:20.239 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:20.317 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:20.314+0000 7fb04eba4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.319 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:20.318+0000 7fb04eba4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.323 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:20.334 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:20.351 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:20.351 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:21.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~232s 2026-02-20T11:40:22.352 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:22.430 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:22.427+0000 7f6a2fa5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:22.432 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:22.431+0000 7f6a2fa5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:22.436 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:22.448 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:22.462 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:22.462 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:23.307 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:23.379 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:23.382 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:23.383 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:24.464 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:24.542 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:24.540+0000 7f4e440cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:24.545 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:24.543+0000 7f4e440cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:24.548 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:24.559 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:24.575 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:24.576 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:26.577 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:26.653 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:26.651+0000 7efd22f5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:26.656 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:26.654+0000 7efd22f5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:26.659 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:26.678 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:26.694 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:26.695 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:26.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~238s 2026-02-20T11:40:28.384 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:28.456 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:28.458 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:28.459 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:28.696 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:28.773 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:28.770+0000 7f3d176cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:28.775 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:28.774+0000 7f3d16442640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:28.779 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:28.791 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:28.809 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:28.809 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:30.810 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:30.886 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:30.884+0000 7f022ba51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:30.889 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:30.887+0000 7f022ba51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:30.892 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:30.904 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:30.920 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:30.920 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:32.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~243s 2026-02-20T11:40:32.921 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:32.998 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:32.996+0000 7f95559b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:33.001 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:32.999+0000 7f95559b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:33.004 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:33.015 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:33.029 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:33.030 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:33.460 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:33.532 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:33.534 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:33.535 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:35.031 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:35.108 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:35.104+0000 7fc20be5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:35.110 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:35.108+0000 7fc20be5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:35.113 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:35.125 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:35.140 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:35.141 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:37.142 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:37.220 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:37.217+0000 7fc3cf50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:37.222 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:37.220+0000 7fc3cf50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:37.226 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:37.238 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:37.251 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:37.252 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:37.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~249s 2026-02-20T11:40:38.536 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:38.608 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:38.611 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:38.612 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:39.253 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:39.330 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:39.327+0000 7f8542db8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.333 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:39.330+0000 7f8542db8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.336 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:39.348 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:39.363 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:39.364 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:41.365 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:41.444 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:41.441+0000 7f89435b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:41.446 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:41.444+0000 7f89435b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:41.449 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:41.461 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:41.475 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:41.475 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:43.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~254s 2026-02-20T11:40:43.477 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:43.553 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:43.550+0000 7f9dda19c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:43.555 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:43.553+0000 7f9dda19c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:43.559 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:43.571 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:43.585 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:43.585 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:43.613 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:43.685 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:43.687 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:43.688 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:45.586 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:45.665 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:45.662+0000 7f818d65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:45.668 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:45.666+0000 7f818d65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:45.671 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:45.683 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:45.699 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:45.699 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:47.701 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:47.776 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:47.773+0000 7efd3295c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:47.779 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:47.776+0000 7efd3295c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:47.782 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:47.793 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:47.807 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:47.807 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:48.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~259s 2026-02-20T11:40:48.689 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:48.761 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:48.764 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:48.765 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:49.808 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:49.884 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:49.881+0000 7fbe2da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:49.886 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:49.884+0000 7fbe2da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:49.889 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:49.901 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:49.916 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:49.916 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:51.917 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:51.994 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:51.991+0000 7f741390b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:51.997 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:51.994+0000 7f741390b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:52.000 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:52.012 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:52.028 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:52.029 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:53.766 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:53.837 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:53.838 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~265s 2026-02-20T11:40:53.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:53.841 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:54.030 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:54.108 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:54.104+0000 7f0672e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:54.110 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:54.108+0000 7f0672e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:54.113 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:54.125 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:54.141 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:54.142 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:56.143 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:56.221 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:56.217+0000 7f74dd1dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:56.223 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:56.222+0000 7f74dd1dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:56.226 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:56.238 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:56.256 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:56.256 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:58.257 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:58.335 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:58.332+0000 7fd7ffccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:58.337 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:40:58.336+0000 7fd7ffccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:58.340 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:40:58.352 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:58.368 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:58.369 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:58.842 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:58.914 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:58.916 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:58.917 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:59.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~270s 2026-02-20T11:41:00.370 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:00.448 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:00.445+0000 7f0110b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:00.450 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:00.449+0000 7f0110b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:00.454 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:00.466 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:00.481 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:00.482 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:02.483 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:02.560 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:02.558+0000 7fc0eb70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:02.562 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:02.561+0000 7fc0eb70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:02.566 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:02.577 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:02.593 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:02.594 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:03.918 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:03.988 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:03.990 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:03.991 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:04.594 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:04.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~276s 2026-02-20T11:41:04.671 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:04.669+0000 7fd5e5b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:04.674 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:04.673+0000 7fd5e5b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:04.677 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:04.688 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:04.704 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:04.705 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:06.706 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:06.783 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:06.781+0000 7fce5a68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:06.785 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:06.784+0000 7fce5a68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:06.788 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:06.800 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:06.817 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:06.818 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:08.818 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:08.895 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:08.893+0000 7f0281e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:08.898 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:08.897+0000 7f0281e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:08.901 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:08.913 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:08.928 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:08.929 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:08.992 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:09.064 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:09.067 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:09.068 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:10.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~281s 2026-02-20T11:41:10.930 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:11.005 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:11.003+0000 7f763a611640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:11.008 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:11.006+0000 7f763a611640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:11.011 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:11.023 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:11.039 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:11.040 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:13.041 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:13.118 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:13.115+0000 7f3cebccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:13.121 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:13.119+0000 7f3cebccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:13.124 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:13.137 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:13.151 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:13.151 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:14.069 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:14.141 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:14.144 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:14.144 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:15.153 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:15.231 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:15.228+0000 7f2c8630b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:15.233 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:15.232+0000 7f2c8630b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:15.237 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:15.248 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:15.264 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:15.265 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:15.452 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~286s 2026-02-20T11:41:17.266 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:17.342 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:17.340+0000 7ff761e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:17.344 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:17.343+0000 7ff761e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:17.348 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:17.359 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:17.372 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:17.373 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:19.145 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:19.217 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:19.219 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:19.220 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:19.374 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:19.452 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:19.449+0000 7fc2da38c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:19.454 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:19.453+0000 7fc2da38c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:19.457 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:19.469 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:19.486 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:19.486 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:20.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~292s 2026-02-20T11:41:21.487 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:21.564 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:21.562+0000 7f300ebed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:21.566 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:21.565+0000 7f300ebed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:21.569 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:21.581 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:21.597 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:21.598 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:23.599 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:23.676 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:23.674+0000 7f69ea70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:23.679 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:23.677+0000 7f69ea70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:23.682 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:23.694 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:23.709 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:23.709 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:24.221 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:24.293 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:24.295 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:24.296 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:25.710 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:25.787 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:25.783+0000 7f25c75cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:25.789 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:25.787+0000 7f25c75cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:25.792 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:25.805 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:25.821 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:25.822 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:26.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~297s 2026-02-20T11:41:27.823 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:27.899 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:27.895+0000 7f1587bb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:27.901 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:27.899+0000 7f1587bb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:27.904 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:27.916 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:27.939 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:27.939 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:29.297 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:29.369 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:29.371 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:29.372 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:29.941 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:30.018 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:30.014+0000 7fb6aed0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:30.020 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:30.018+0000 7fb6aed0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:30.024 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:41:30.036 INFO:teuthology.orchestra.run.trial046.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:30.051 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:30.052 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:31.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~303s 2026-02-20T11:41:31.662 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2026-02-20T11:41:32.053 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:32.064 ERROR:tasks.ceph.osd.0:No such daemon running 2026-02-20T11:41:32.065 INFO:tasks.ceph.osd.1:Sent signal 15 2026-02-20T11:41:32.065 INFO:tasks.ceph.osd.3:Sent signal 15 2026-02-20T11:41:32.065 INFO:tasks.ceph.mon.a:Sent signal 15 2026-02-20T11:41:32.066 INFO:tasks.ceph.mgr.x:Sent signal 15 2026-02-20T11:41:32.066 INFO:tasks.daemonwatchdog.daemon_watchdog:Killing thrasher OSDThrasher 2026-02-20T11:41:32.066 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-20T11:41:32.065+0000 7f0aabbf8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 39164) UID: 0 2026-02-20T11:41:32.067 INFO:tasks.ceph.mgr.x.trial086.stderr:2026-02-20T11:41:32.065+0000 7f0aabbf8640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-20T11:41:32.098 INFO:tasks.ceph.mon.a.trial046.stderr:2026-02-20T11:41:32.096+0000 7f351f3fc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 39690) UID: 0 2026-02-20T11:41:32.098 INFO:tasks.ceph.mon.a.trial046.stderr:2026-02-20T11:41:32.096+0000 7f351f3fc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-20T11:41:32.131 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:41:32.128+0000 7f0da8a46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:34.373 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:34.445 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:34.447 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:34.448 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:39.448 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:39.520 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:39.523 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:39.524 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:44.524 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:44.598 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:44.601 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:44.602 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:49.603 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:49.676 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:49.679 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:49.680 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:54.681 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:54.753 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:54.756 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:54.756 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:59.757 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:59.829 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:59.832 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:59.833 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:42:04.834 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:42:04.907 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:04.910 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:04.910 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:42:09.911 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:42:09.983 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:09.986 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:09.986 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:42:14.987 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:42:15.059 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:15.061 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:15.062 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:42:20.063 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:42:20.136 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:20.139 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:20.140 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:42:25.141 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:42:25.213 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:25.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:25.217 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:42:30.218 DEBUG:teuthology.orchestra.run.trial086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:42:30.291 INFO:teuthology.orchestra.run.trial086.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:30.293 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:30.294 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.2 restart 2026-02-20T11:42:30.294 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1384, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.2 restart 2026-02-20T11:42:30.295 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T11:43:32.087 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T11:43:32.087 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:43:34.088 INFO:tasks.daemonwatchdog.daemon_watchdog:Killing remote process ceph-test-rados-ceph 2026-02-20T11:43:34.088 DEBUG:tasks.rados:Stopping ceph-test-rados-ceph due to exception The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T11:43:34.088 INFO:tasks.rados:Stopping instance 0 2026-02-20T11:43:34.100 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T11:43:34.102 ERROR:teuthology.run_tasks:Manager failed: rados Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T11:43:34.104 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2026-02-20T11:43:34.119 INFO:tasks.thrashosds:joining thrashosds 2026-02-20T11:43:34.119 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T11:43:34.119 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T11:43:34.119 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:43:34.216 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:43:34.213+0000 7fec2441a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:45:34.171 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T11:45:34.172 ERROR:teuthology.run_tasks:Manager failed: thrashosds Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial046 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2026-02-20T11:45:34.177 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T11:45:34.197 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:45:34.197 DEBUG:teuthology.orchestra.run.trial046:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:45:34.275 INFO:teuthology.orchestra.run.trial046.stderr:2026-02-20T11:45:34.271+0000 7f78455fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:47:34.229 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T11:47:34.230 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial046 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T11:47:34.234 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T11:47:34.235 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T11:47:34.235 ERROR:tasks.ceph.osd.0:tried to stop a non-running daemon 2026-02-20T11:47:34.235 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T11:47:34.235 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:47:34.293 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T11:47:34.294 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T11:47:34.294 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:47:34.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:47:34.294 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 1525, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial046 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial086 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log' 2026-02-20T11:47:34.299 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T11:47:34.300 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T11:47:34.300 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:47:34.360 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T11:47:34.360 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T11:47:34.360 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T11:47:34.360 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:47:34.360 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T11:47:34.361 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T11:47:34.361 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T11:47:34.361 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:47:34.361 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T11:47:34.361 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T11:47:34.362 DEBUG:teuthology.orchestra.run.trial046:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'objects unfound and apparently lost' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | head -n 1 2026-02-20T11:47:34.390 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial046.front.sepia.ceph.com 2026-02-20T11:47:34.391 DEBUG:teuthology.orchestra.run.trial046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T11:47:34.457 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial046.front.sepia.ceph.com 2026-02-20T11:47:34.457 DEBUG:teuthology.orchestra.run.trial046:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T11:47:34.524 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial086.front.sepia.ceph.com 2026-02-20T11:47:34.525 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T11:47:34.555 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial086.front.sepia.ceph.com 2026-02-20T11:47:34.555 DEBUG:teuthology.orchestra.run.trial086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-20T11:47:34.622 INFO:tasks.ceph:Archiving mon data... 2026-02-20T11:47:34.624 DEBUG:teuthology.misc:Transferring archived files from trial046:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517/data/mon.a.tgz 2026-02-20T11:47:34.624 DEBUG:teuthology.orchestra.run.trial046:> mktemp 2026-02-20T11:47:34.642 INFO:teuthology.orchestra.run.trial046.stdout:/tmp/tmp.r1EPfPKnyF 2026-02-20T11:47:34.643 DEBUG:teuthology.orchestra.run.trial046:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.r1EPfPKnyF 2026-02-20T11:47:34.740 DEBUG:teuthology.orchestra.run.trial046:> sudo chmod 0666 /tmp/tmp.r1EPfPKnyF 2026-02-20T11:47:34.821 DEBUG:teuthology.orchestra.remote:trial046:/tmp/tmp.r1EPfPKnyF is 281KB 2026-02-20T11:47:34.916 DEBUG:teuthology.orchestra.run.trial046:> rm -fr /tmp/tmp.r1EPfPKnyF 2026-02-20T11:47:34.933 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T11:47:34.933 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T11:47:34.974 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T11:47:35.052 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T11:47:35.069 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T11:47:35.069 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T11:47:35.072 DEBUG:teuthology.misc:Transferring archived files from trial046:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517/remote/trial046/crash 2026-02-20T11:47:35.073 DEBUG:teuthology.orchestra.run.trial046:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T11:47:35.117 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517/remote/trial086/crash 2026-02-20T11:47:35.118 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T11:47:35.144 INFO:tasks.ceph:Compressing logs... 2026-02-20T11:47:35.144 DEBUG:teuthology.orchestra.run.trial046:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T11:47:35.161 DEBUG:teuthology.orchestra.run.trial086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T11:47:35.221 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39264.log 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39416.log 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39311.log 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-client.admin.39264.log: /var/log/ceph/ceph-client.admin.39416.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-mgr.x.log 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39264.log.gz 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39416.log.gz 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39364.log/var/log/ceph/ceph-client.admin.39311.log: 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39311.log.gz 2026-02-20T11:47:35.222 INFO:teuthology.orchestra.run.trial086.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.39364.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39364.log.gz 2026-02-20T11:47:35.234 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44299.log 2026-02-20T11:47:35.234 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46260.log 2026-02-20T11:47:35.234 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46101.log 2026-02-20T11:47:35.234 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44299.log.gz 2026-02-20T11:47:35.234 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46260.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46260.log.gz 2026-02-20T11:47:35.234 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46419.log 2026-02-20T11:47:35.234 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46101.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T11:47:35.234 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46101.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40887.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46419.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41383.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39826.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40887.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41912.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41383.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.39826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40060.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39826.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48275.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41912.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40060.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40060.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47904.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.48275.log: -- /var/log/ceph/ceph-osd.0.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48275.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47904.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46844.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45518.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43027.log 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46844.log.gz 2026-02-20T11:47:35.235 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45518.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45518.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48911.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43027.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48593.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45624.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44882.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr: 8.8% -- replaced with /var/log/ceph/ceph-client.admin.48911.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45624.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45836.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.44882.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47745.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45836.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45836.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38624.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45889.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42815.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph.tmp-client.admin.38624.log: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38624.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47851.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42815.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.42815.log.gz 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46578.log 2026-02-20T11:47:35.236 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40348.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47851.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46578.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46578.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44935.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40348.log: gzip 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40348.log.gz -5 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48805.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44935.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44935.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40129.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48805.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48805.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40199.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40129.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40129.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45677.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40199.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40199.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45677.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45677.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46950.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48328.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46950.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46950.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46154.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41083.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41536.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45995.log 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41083.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41083.log.gz 2026-02-20T11:47:35.237 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48540.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45995.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45995.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44988.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48540.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48540.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40573.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47268.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44988.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40573.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40573.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44405.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39779.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47268.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44405.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44405.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47692.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.39779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47109.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39779.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47692.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47692.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40446.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48381.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47109.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40446.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40446.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48752.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45253.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48381.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48752.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48752.log.gz 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40299.log 2026-02-20T11:47:35.238 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43822.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45253.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40299.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40299.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44352.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40226.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.43822.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44352.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44352.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41965.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40226.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.40226.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43557.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39693.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48858.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41965.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.39693.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39693.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44193.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46366.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48858.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44193.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44193.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42709.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46366.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42709.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42709.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46738.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2026-02-20T11:47:35.239 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47321.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.49000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41689.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr: 8.8% -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47321.log: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.47321.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46048.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41384.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41689.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46048.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46048.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40773.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45465.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41384.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40773.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40773.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48010.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45465.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48010.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48010.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47374.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41859.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47374.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47374.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41034.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41132.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41859.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47957.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41034.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43504.log 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41132.log.gz 2026-02-20T11:47:35.240 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47957.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47957.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43451.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44246.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43504.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43451.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.43451.log.gz -5 --verbose 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr: -- /var/log/ceph/ceph-client.admin.42444.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43398.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44246.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40936.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42444.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41741.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43398.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44829.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40936.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48169.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41741.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44829.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44829.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41487.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45147.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48169.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41487.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41487.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42390.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45147.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45147.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40576.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42124.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42390.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40576.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40576.log.gz 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45571.log 2026-02-20T11:47:35.241 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43292.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42124.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42124.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45571.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45571.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46897.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43292.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46897.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46897.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40717.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43769.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40774.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40717.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40717.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42177.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40774.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.40774.log.gz -5 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42177.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42177.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41257.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41257.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41257.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48222.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47427.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48222.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48222.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42762.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43239.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47003.log 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42762.log.gz 2026-02-20T11:47:35.242 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43239.log: 87.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.42868.log -- replaced with /var/log/ceph/ceph-client.admin.43239.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45942.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47003.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43080.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42868.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45942.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45942.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45359.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43080.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42497.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47162.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43610.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45359.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47162.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47162.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43663.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43610.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43610.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45730.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43663.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43663.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42071.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45730.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41590.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46207.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42071.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.0.41590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.0.41590.log.gz 2026-02-20T11:47:35.243 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44140.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46207.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44670.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43186.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44140.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42974.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44670.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45200.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43186.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42974.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42974.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45200.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45200.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47215.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47480.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42550.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43716.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47215.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47480.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47480.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48434.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43716.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43716.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45094.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48434.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48434.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48063.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43875.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45094.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48063.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48063.log.gz 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47798.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48487.log 2026-02-20T11:47:35.244 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43875.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47798.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47798.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45041.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48487.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48487.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43133.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45041.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45041.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48116.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43133.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43133.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46525.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48116.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48116.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42018.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46525.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46525.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46632.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42018.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42018.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43981.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46632.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46632.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47533.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43981.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43981.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42283.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47533.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47533.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44087.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42283.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42283.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40718.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44087.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44087.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42656.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40718.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40718.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46472.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42656.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42656.log.gz 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44034.log 2026-02-20T11:47:35.245 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46472.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46472.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41793.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44034.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.44034.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46685.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41793.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46685.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46685.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41382.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44723.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41382.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41382.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40575.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44723.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44723.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44564.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40575.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40575.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41181.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46791.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44564.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41181.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41181.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40034.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43345.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46791.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40034.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40034.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45783.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.43345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40574.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43345.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45783.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45783.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40574.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40574.log.gz 2026-02-20T11:47:35.246 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44511.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45412.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47056.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.45412.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45412.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42336.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42921.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47056.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr: 91.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42336.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42336.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47586.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46313.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42921.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42230.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.46313.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46313.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.42230.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42230.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.47639.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41633.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40397.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40985.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.41633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44617.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41633.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.40397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48963.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40397.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.44617.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44617.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48699.log 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48963.log: 8.8% -- replaced with /var/log/ceph/ceph-client.admin.48963.log.gz 2026-02-20T11:47:35.247 INFO:teuthology.orchestra.run.trial046.stderr:/var/log/ceph/ceph-client.admin.48699.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48699.log.gz 2026-02-20T11:47:35.248 INFO:teuthology.orchestra.run.trial086.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T11:47:35.286 INFO:teuthology.orchestra.run.trial046.stderr: 89.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T11:47:35.502 INFO:teuthology.orchestra.run.trial046.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T11:47:35.629 INFO:teuthology.orchestra.run.trial046.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T11:47:35.631 INFO:teuthology.orchestra.run.trial046.stderr: 2026-02-20T11:47:35.631 INFO:teuthology.orchestra.run.trial046.stderr:real 0m0.458s 2026-02-20T11:47:35.631 INFO:teuthology.orchestra.run.trial046.stderr:user 0m0.852s 2026-02-20T11:47:35.631 INFO:teuthology.orchestra.run.trial046.stderr:sys 0m0.113s 2026-02-20T11:47:35.698 INFO:teuthology.orchestra.run.trial086.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T11:47:35.705 INFO:teuthology.orchestra.run.trial086.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-20T11:47:35.707 INFO:teuthology.orchestra.run.trial086.stderr: 2026-02-20T11:47:35.707 INFO:teuthology.orchestra.run.trial086.stderr:real 0m0.498s 2026-02-20T11:47:35.707 INFO:teuthology.orchestra.run.trial086.stderr:user 0m0.954s 2026-02-20T11:47:35.707 INFO:teuthology.orchestra.run.trial086.stderr:sys 0m0.063s 2026-02-20T11:47:35.707 INFO:tasks.ceph:Archiving logs... 2026-02-20T11:47:35.707 DEBUG:teuthology.misc:Transferring archived files from trial046:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517/remote/trial046/log 2026-02-20T11:47:35.709 DEBUG:teuthology.orchestra.run.trial046:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T11:47:35.987 DEBUG:teuthology.misc:Transferring archived files from trial086:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517/remote/trial086/log 2026-02-20T11:47:35.987 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T11:47:36.171 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial046 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T11:47:36.172 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T11:47:36.182 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T11:47:36.295 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T11:47:36.306 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T11:47:36.307 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T11:47:36.307 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T11:47:36.309 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T11:47:36.334 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T11:47:36.345 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T11:47:36.345 DEBUG:teuthology.orchestra.run.trial046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:47:36.374 DEBUG:teuthology.orchestra.run.trial086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:47:36.387 INFO:teuthology.orchestra.run.trial046.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:47:36.389 INFO:teuthology.orchestra.run.trial086.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:47:36.750 INFO:teuthology.orchestra.run.trial046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:47:36.750 INFO:teuthology.orchestra.run.trial046.stdout:=============================================================================== 2026-02-20T11:47:36.750 INFO:teuthology.orchestra.run.trial046.stdout:^- 45-79-189-79.ip.linodeus> 3 6 377 60 +352us[ +352us] +/- 31ms 2026-02-20T11:47:36.750 INFO:teuthology.orchestra.run.trial046.stdout:^* pool-138-89-14-60.mad.ea> 1 7 377 122 +132us[ +225us] +/- 2885us 2026-02-20T11:47:36.751 INFO:teuthology.orchestra.run.trial046.stdout:^- 170-187-142-180.ip.linod> 2 7 377 58 -11ms[ -11ms] +/- 82ms 2026-02-20T11:47:36.751 INFO:teuthology.orchestra.run.trial046.stdout:^- 172-238-164-57.ip.linode> 4 6 377 58 -4406us[-4406us] +/- 34ms 2026-02-20T11:47:36.752 INFO:teuthology.orchestra.run.trial086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:47:36.753 INFO:teuthology.orchestra.run.trial086.stdout:=============================================================================== 2026-02-20T11:47:36.753 INFO:teuthology.orchestra.run.trial086.stdout:^- white.web-ster.com 4 6 377 59 +3001us[+3001us] +/- 68ms 2026-02-20T11:47:36.753 INFO:teuthology.orchestra.run.trial086.stdout:^- 172-233-157-223.ip.linod> 2 6 377 60 -12ms[ -12ms] +/- 128ms 2026-02-20T11:47:36.753 INFO:teuthology.orchestra.run.trial086.stdout:^* 216-144-228-179-host.col> 2 6 377 60 -17us[ -38us] +/- 11ms 2026-02-20T11:47:36.753 INFO:teuthology.orchestra.run.trial086.stdout:^- 155.248.196.28 2 6 377 62 -927us[ -948us] +/- 50ms 2026-02-20T11:47:36.753 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T11:47:36.771 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T11:47:36.772 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T11:47:36.788 DEBUG:teuthology.orchestra.run.trial046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T11:47:36.850 DEBUG:teuthology.orchestra.run.trial086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T11:47:36.906 DEBUG:teuthology.orchestra.run.trial046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:47:36.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:47:36.934 DEBUG:teuthology.orchestra.run.trial086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:47:36.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:47:36.962 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T11:47:36.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T11:47:36.994 INFO:teuthology.task.internal:Duration was 1469.102915 seconds 2026-02-20T11:47:36.995 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T11:47:37.011 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T11:47:37.011 DEBUG:teuthology.orchestra.run.trial046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T11:47:37.014 DEBUG:teuthology.orchestra.run.trial086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T11:47:37.049 INFO:teuthology.orchestra.run.trial046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:47:37.051 INFO:teuthology.orchestra.run.trial086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:47:37.354 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T11:47:37.355 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial046.front.sepia.ceph.com 2026-02-20T11:47:37.355 DEBUG:teuthology.orchestra.run.trial046:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T11:47:37.375 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial086.front.sepia.ceph.com 2026-02-20T11:47:37.376 DEBUG:teuthology.orchestra.run.trial086:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T11:47:37.414 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T11:47:37.414 DEBUG:teuthology.orchestra.run.trial046:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T11:47:37.418 DEBUG:teuthology.orchestra.run.trial086:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T11:47:37.515 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T11:47:37.515 DEBUG:teuthology.orchestra.run.trial046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T11:47:37.518 DEBUG:teuthology.orchestra.run.trial086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T11:47:37.540 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:47:37.540 INFO:teuthology.orchestra.run.trial046.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:47:37.541 INFO:teuthology.orchestra.run.trial046.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T11:47:37.542 INFO:teuthology.orchestra.run.trial046.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T11:47:37.542 INFO:teuthology.orchestra.run.trial046.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T11:47:37.543 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:47:37.543 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:47:37.543 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T11:47:37.543 INFO:teuthology.orchestra.run.trial086.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T11:47:37.543 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T11:47:37.552 INFO:teuthology.orchestra.run.trial046.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T11:47:37.553 INFO:teuthology.orchestra.run.trial086.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T11:47:37.555 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T11:47:37.572 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T11:47:37.572 DEBUG:teuthology.orchestra.run.trial046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T11:47:37.619 DEBUG:teuthology.orchestra.run.trial086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T11:47:37.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T11:47:37.663 DEBUG:teuthology.orchestra.run.trial046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T11:47:37.666 DEBUG:teuthology.orchestra.run.trial086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T11:47:37.688 INFO:teuthology.orchestra.run.trial046.stdout:kernel.core_pattern = core 2026-02-20T11:47:37.710 INFO:teuthology.orchestra.run.trial086.stdout:kernel.core_pattern = core 2026-02-20T11:47:37.738 DEBUG:teuthology.orchestra.run.trial046:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T11:47:37.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:47:37.756 DEBUG:teuthology.orchestra.run.trial086:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T11:47:37.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:47:37.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T11:47:37.813 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T11:47:37.814 DEBUG:teuthology.misc:Transferring archived files from trial046:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517/remote/trial046 2026-02-20T11:47:37.814 DEBUG:teuthology.orchestra.run.trial046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T11:47:37.849 DEBUG:teuthology.misc:Transferring archived files from trial086:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60517/remote/trial086 2026-02-20T11:47:37.850 DEBUG:teuthology.orchestra.run.trial086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T11:47:37.887 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T11:47:37.887 DEBUG:teuthology.orchestra.run.trial046:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T11:47:37.890 DEBUG:teuthology.orchestra.run.trial086:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T11:47:37.935 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T11:47:37.955 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T11:47:37.955 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T11:47:37.972 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T11:47:37.973 DEBUG:teuthology.orchestra.run.trial046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T11:47:37.975 DEBUG:teuthology.orchestra.run.trial086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T11:47:37.989 INFO:teuthology.orchestra.run.trial046.stdout: 917572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 11:47 /home/ubuntu/cephtest 2026-02-20T11:47:37.991 INFO:teuthology.orchestra.run.trial086.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 11:47 /home/ubuntu/cephtest 2026-02-20T11:47:37.992 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T11:47:38.012 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T11:47:38.035 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: BarkError: The WatchDog barked due to Daemon ceph.osd.2 has failed 2026-02-20T11:47:38.040 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/segmented$/{crimson_seastore_segmented} thrashers/{default} thrashosds-health workloads/snaps-few-objects} duration: 1469.1029152870178 failure_reason: The WatchDog barked due to Daemon ceph.osd.2 has failed flavor: debug owner: scheduled_jjperez@soko04.front.sepia.ceph.com status: fail success: false 2026-02-20T11:47:38.040 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:47:38.156 INFO:teuthology.run:FAIL