2026-02-24T15:33:59.652 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T15:33:59.667 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T15:33:59.742 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial/68165 branch: wip-liucm-shard-redesign-crimson-only description: crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool} email: null first_in_suite: false flavor: debug job_id: '68165' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-liucm-shard-redesign-crimson-only ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd pool default crimson: true osd: crimson cpu num: 3 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd objectstore: seastore seastore cachepin size pershard: 64M seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(OBJECT_ - for optimal performance sha1: d26e5c228e3cdea4d585bcd077f8513a649ab5d1 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: d26e5c228e3cdea4d585bcd077f8513a649ab5d1 workunit: branch: wip-liucm-shard-redesign-crimson-only env: CRIMSON_COMPAT: '1' sha1: d26e5c228e3cdea4d585bcd077f8513a649ab5d1 owner: scheduled_liucm@soko04.front.sepia.ceph.com priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - client.0 seed: 9834 sha1: d26e5c228e3cdea4d585bcd077f8513a649ab5d1 sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-liucm-shard-redesign-crimson-only suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d26e5c228e3cdea4d585bcd077f8513a649ab5d1/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d26e5c228e3cdea4d585bcd077f8513a649ab5d1 targets: trial053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBf74I6lQX8UzajKEwZt3MwgC0b+OI5Y40XI9q+Tj/tT3n/qk7h2ip7SWoewfX1ULe7dCNVmpui4N3ZQlGna1xk= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 - ceph_objectstore_tool: crimson_objectstore_tool: true objects: 5 pgnum: 8 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_15:28:57 tube: trial user: liucm verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T15:33:59.742 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d26e5c228e3cdea4d585bcd077f8513a649ab5d1/qa; will attempt to use it 2026-02-24T15:33:59.742 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d26e5c228e3cdea4d585bcd077f8513a649ab5d1/qa/tasks 2026-02-24T15:33:59.742 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-24T15:33:59.744 INFO:teuthology.task.internal:Checking packages... 2026-02-24T15:33:59.744 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1' 2026-02-24T15:33:59.744 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-24T15:33:59.744 INFO:teuthology.packaging:ref: None 2026-02-24T15:33:59.744 INFO:teuthology.packaging:tag: None 2026-02-24T15:33:59.744 INFO:teuthology.packaging:branch: wip-liucm-shard-redesign-crimson-only 2026-02-24T15:33:59.744 INFO:teuthology.packaging:sha1: d26e5c228e3cdea4d585bcd077f8513a649ab5d1 2026-02-24T15:33:59.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-liucm-shard-redesign-crimson-only 2026-02-24T15:33:59.865 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5343.gd26e5c22 2026-02-24T15:33:59.868 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-24T15:33:59.881 INFO:teuthology.task.internal:no buildpackages task found 2026-02-24T15:33:59.881 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T15:33:59.896 INFO:teuthology.task.internal:Saving configuration 2026-02-24T15:33:59.905 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T15:33:59.918 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T15:33:59.996 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial053.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial/68165', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 15:30:32.184812', 'locked_by': 'scheduled_liucm@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBf74I6lQX8UzajKEwZt3MwgC0b+OI5Y40XI9q+Tj/tT3n/qk7h2ip7SWoewfX1ULe7dCNVmpui4N3ZQlGna1xk='} 2026-02-24T15:33:59.996 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T15:34:00.010 INFO:teuthology.task.internal:roles: ubuntu@trial053.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-24T15:34:00.010 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T15:34:00.097 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7c2b8b555800>, signals=[15]) 2026-02-24T15:34:00.097 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T15:34:00.107 INFO:teuthology.task.internal:Opening connections... 2026-02-24T15:34:00.107 DEBUG:teuthology.task.internal:connecting to ubuntu@trial053.front.sepia.ceph.com 2026-02-24T15:34:00.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T15:34:00.189 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T15:34:00.204 DEBUG:teuthology.orchestra.run.trial053:> uname -m 2026-02-24T15:34:00.263 INFO:teuthology.orchestra.run.trial053.stdout:x86_64 2026-02-24T15:34:00.263 DEBUG:teuthology.orchestra.run.trial053:> cat /etc/os-release 2026-02-24T15:34:00.318 INFO:teuthology.orchestra.run.trial053.stdout:NAME="CentOS Stream" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:VERSION="9" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:ID="centos" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:ID_LIKE="rhel fedora" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:VERSION_ID="9" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:PLATFORM_ID="platform:el9" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:ANSI_COLOR="0;31" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:LOGO="fedora-logo-icon" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:HOME_URL="https://centos.org/" 2026-02-24T15:34:00.319 INFO:teuthology.orchestra.run.trial053.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T15:34:00.320 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T15:34:00.320 INFO:teuthology.orchestra.run.trial053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T15:34:00.321 INFO:teuthology.lock.ops:Updating trial053.front.sepia.ceph.com on lock server 2026-02-24T15:34:00.406 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T15:34:00.419 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T15:34:00.431 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T15:34:00.431 DEBUG:teuthology.orchestra.run.trial053:> test '!' -e /home/ubuntu/cephtest 2026-02-24T15:34:00.446 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T15:34:00.457 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T15:34:00.457 DEBUG:teuthology.orchestra.run.trial053:> test -z $(ls -A /var/lib/ceph) 2026-02-24T15:34:00.502 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T15:34:00.664 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T15:34:00.684 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-24T15:34:00.684 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-24T15:34:00.684 DEBUG:teuthology.orchestra.run.trial053:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T15:34:00.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T15:34:00.699 DEBUG:teuthology.orchestra.run.trial053:> uname -r 2026-02-24T15:34:00.754 INFO:teuthology.orchestra.run.trial053.stdout:5.14.0-681.el9.x86_64 2026-02-24T15:34:00.755 INFO:teuthology.task.kernel:Running kernel on trial053: 5.14.0-681.el9.x86_64 2026-02-24T15:34:00.755 DEBUG:teuthology.orchestra.run.trial053:> sudo yum install -y kernel 2026-02-24T15:34:02.037 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.9 MB 00:00 2026-02-24T15:34:21.905 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 27 MB 00:19 2026-02-24T15:34:25.326 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 8.0 MB 00:01 2026-02-24T15:34:26.174 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - Extras packages 192 kB/s | 20 kB 00:00 2026-02-24T15:34:27.283 INFO:teuthology.orchestra.run.trial053.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-24T15:34:30.498 INFO:teuthology.orchestra.run.trial053.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-24T15:34:31.507 INFO:teuthology.orchestra.run.trial053.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T15:34:31.507 INFO:teuthology.orchestra.run.trial053.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T15:34:31.527 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout: Package Architecture Version Repository Size 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T15:34:31.529 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:34:31.530 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:34:31.530 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:34:31.530 INFO:teuthology.orchestra.run.trial053.stdout:Install 4 Packages 2026-02-24T15:34:31.530 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:34:31.530 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 89 M 2026-02-24T15:34:31.530 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 135 M 2026-02-24T15:34:31.530 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:34:31.787 INFO:teuthology.orchestra.run.trial053.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 4.4 MB/s | 901 kB 00:00 2026-02-24T15:34:31.971 INFO:teuthology.orchestra.run.trial053.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 45 MB/s | 17 MB 00:00 2026-02-24T15:34:32.124 INFO:teuthology.orchestra.run.trial053.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 92 MB/s | 31 MB 00:00 2026-02-24T15:34:32.180 INFO:teuthology.orchestra.run.trial053.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 67 MB/s | 40 MB 00:00 2026-02-24T15:34:32.180 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:34:32.180 INFO:teuthology.orchestra.run.trial053.stdout:Total 136 MB/s | 89 MB 00:00 2026-02-24T15:34:32.372 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:34:32.573 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:34:32.574 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:34:32.956 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:34:32.956 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:34:34.093 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:34:34.401 INFO:teuthology.orchestra.run.trial053.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T15:34:34.423 INFO:teuthology.orchestra.run.trial053.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T15:34:36.972 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T15:34:37.005 INFO:teuthology.orchestra.run.trial053.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T15:34:40.037 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T15:34:40.042 INFO:teuthology.orchestra.run.trial053.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T15:34:43.094 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T15:35:00.565 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T15:35:00.586 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T15:35:00.773 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T15:35:00.773 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T15:35:00.773 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T15:35:00.773 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T15:35:00.829 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T15:35:00.830 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:35:00.830 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:35:00.830 INFO:teuthology.orchestra.run.trial053.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T15:35:00.830 INFO:teuthology.orchestra.run.trial053.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T15:35:00.830 INFO:teuthology.orchestra.run.trial053.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T15:35:00.830 INFO:teuthology.orchestra.run.trial053.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T15:35:00.830 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:35:00.830 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:35:00.890 DEBUG:teuthology.orchestra.run.trial053:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T15:35:00.918 INFO:teuthology.orchestra.run.trial053.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T15:35:00.920 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T15:35:00.920 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T15:35:00.920 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T15:35:00.920 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T15:35:00.920 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-24T15:35:00.920 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial053.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T15:35:00.920 DEBUG:teuthology.orchestra.run.trial053:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T15:35:00.985 INFO:teuthology.orchestra.run.trial053.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T15:35:00.986 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T15:35:00.986 DEBUG:teuthology.orchestra.run.trial053:> sudo rpm -qi grub2-tools 2026-02-24T15:35:01.057 INFO:teuthology.orchestra.run.trial053.stdout:Name : grub2-tools 2026-02-24T15:35:01.057 INFO:teuthology.orchestra.run.trial053.stdout:Epoch : 1 2026-02-24T15:35:01.057 INFO:teuthology.orchestra.run.trial053.stdout:Version : 2.06 2026-02-24T15:35:01.057 INFO:teuthology.orchestra.run.trial053.stdout:Release : 120.el9 2026-02-24T15:35:01.057 INFO:teuthology.orchestra.run.trial053.stdout:Architecture: x86_64 2026-02-24T15:35:01.057 INFO:teuthology.orchestra.run.trial053.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T15:35:01.057 INFO:teuthology.orchestra.run.trial053.stdout:Group : Unspecified 2026-02-24T15:35:01.057 INFO:teuthology.orchestra.run.trial053.stdout:Size : 9108611 2026-02-24T15:35:01.057 INFO:teuthology.orchestra.run.trial053.stdout:License : GPLv3+ 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:Packager : builder@centos.org 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:Vendor : CentOS 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:Summary : Support tools for GRUB. 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:Description : 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:35:01.058 INFO:teuthology.orchestra.run.trial053.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T15:35:01.059 INFO:teuthology.orchestra.run.trial053.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T15:35:01.059 INFO:teuthology.orchestra.run.trial053.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T15:35:01.059 INFO:teuthology.orchestra.run.trial053.stdout:hardware devices. 2026-02-24T15:35:01.059 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:35:01.059 INFO:teuthology.orchestra.run.trial053.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T15:35:01.060 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T15:35:01.060 INFO:teuthology.task.kernel:Updating grub on trial053 to boot 5.14.0-686.el9.x86_64 2026-02-24T15:35:01.061 DEBUG:teuthology.orchestra.run.trial053:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T15:35:01.122 INFO:teuthology.orchestra.run.trial053.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T15:35:01.124 DEBUG:teuthology.orchestra.run.trial053:> sudo command -v grubby && echo yes || echo no 2026-02-24T15:35:01.188 INFO:teuthology.orchestra.run.trial053.stdout:/sbin/grubby 2026-02-24T15:35:01.190 INFO:teuthology.orchestra.run.trial053.stdout:yes 2026-02-24T15:35:01.190 DEBUG:teuthology.orchestra.run.trial053:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T15:35:01.253 INFO:teuthology.orchestra.run.trial053.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T15:35:01.254 DEBUG:teuthology.orchestra.run.trial053:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T15:35:01.325 DEBUG:teuthology.orchestra.run.trial053:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T15:35:01.532 INFO:teuthology.orchestra.run.trial053.stderr:Generating grub configuration file ... 2026-02-24T15:35:01.600 INFO:teuthology.orchestra.run.trial053.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T15:35:01.607 INFO:teuthology.orchestra.run.trial053.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T15:35:01.860 INFO:teuthology.orchestra.run.trial053.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T15:35:01.867 INFO:teuthology.orchestra.run.trial053.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T15:35:01.900 INFO:teuthology.orchestra.run.trial053.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T15:35:01.907 INFO:teuthology.orchestra.run.trial053.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T15:35:01.938 INFO:teuthology.orchestra.run.trial053.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T15:35:01.945 INFO:teuthology.orchestra.run.trial053.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T15:35:01.968 INFO:teuthology.orchestra.run.trial053.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T15:35:01.974 INFO:teuthology.orchestra.run.trial053.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T15:35:02.061 INFO:teuthology.orchestra.run.trial053.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T15:35:02.070 INFO:teuthology.orchestra.run.trial053.stderr:done 2026-02-24T15:35:02.072 DEBUG:teuthology.orchestra.run.trial053:> test -d /sys/firmware/efi 2026-02-24T15:35:02.088 DEBUG:teuthology.orchestra.run.trial053:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T15:35:02.153 INFO:teuthology.orchestra.run.trial053.stdout:/boot/efi/EFI/BOOT 2026-02-24T15:35:02.154 INFO:teuthology.orchestra.run.trial053.stdout:/boot/efi/EFI/centos 2026-02-24T15:35:02.155 DEBUG:teuthology.orchestra.run.trial053:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T15:35:02.221 INFO:teuthology.orchestra.run.trial053.stdout:no 2026-02-24T15:35:02.221 DEBUG:teuthology.orchestra.run.trial053:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T15:35:02.285 INFO:teuthology.orchestra.run.trial053.stdout:yes 2026-02-24T15:35:02.286 DEBUG:teuthology.orchestra.run.trial053:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T15:35:02.349 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial053 2026-02-24T15:35:02.349 DEBUG:teuthology.orchestra.run.trial053:> sudo bash -c ' 2026-02-24T15:35:02.349 DEBUG:teuthology.orchestra.run.trial053:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T15:35:02.349 DEBUG:teuthology.orchestra.run.trial053:> ' 2026-02-24T15:35:32.392 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-24T15:35:32.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial053.front.sepia.ceph.com' 2026-02-24T15:35:32.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T15:36:32.437 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T15:36:41.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial053.front.sepia.ceph.com' 2026-02-24T15:36:41.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T15:36:41.640 DEBUG:teuthology.orchestra.run.trial053:> true 2026-02-24T15:36:41.793 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial053.front.sepia.ceph.com' 2026-02-24T15:36:41.793 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-24T15:36:41.793 DEBUG:teuthology.orchestra.run.trial053:> uname -r 2026-02-24T15:36:41.849 INFO:teuthology.orchestra.run.trial053.stdout:5.14.0-686.el9.x86_64 2026-02-24T15:36:41.849 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T15:36:41.849 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T15:36:41.849 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T15:36:42.850 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-24T15:36:42.851 DEBUG:teuthology.orchestra.run.trial053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T15:36:42.881 INFO:teuthology.orchestra.run.trial053.stdout:ttyS1 2026-02-24T15:36:42.902 DEBUG:teuthology.parallel:result is None 2026-02-24T15:36:42.902 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T15:36:42.913 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T15:36:42.913 DEBUG:teuthology.orchestra.run.trial053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T15:36:42.958 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T15:36:42.972 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T15:36:42.985 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T15:36:42.986 DEBUG:teuthology.orchestra.run.trial053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T15:36:43.021 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T15:36:43.035 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T15:36:43.036 DEBUG:teuthology.orchestra.run.trial053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T15:36:43.079 INFO:teuthology.orchestra.run.trial053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T15:36:43.088 INFO:teuthology.orchestra.run.trial053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T15:36:43.089 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T15:36:43.101 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T15:36:43.101 DEBUG:teuthology.orchestra.run.trial053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T15:36:43.154 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T15:36:43.171 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T15:36:43.172 DEBUG:teuthology.orchestra.run.trial053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T15:36:43.209 DEBUG:teuthology.orchestra.run.trial053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T15:36:43.373 DEBUG:teuthology.orchestra.run.trial053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T15:36:43.397 DEBUG:teuthology.orchestra.run.trial053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T15:36:43.550 DEBUG:teuthology.orchestra.run.trial053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T15:36:43.574 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T15:36:43.575 DEBUG:teuthology.orchestra.run.trial053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T15:36:43.638 DEBUG:teuthology.orchestra.run.trial053:> sudo service rsyslog restart 2026-02-24T15:36:43.706 INFO:teuthology.orchestra.run.trial053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T15:36:44.107 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T15:36:44.123 INFO:teuthology.task.internal:Starting timer... 2026-02-24T15:36:44.123 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T15:36:44.144 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T15:36:44.161 DEBUG:teuthology.orchestra.run.trial053:> sudo service auditd rotate 2026-02-24T15:36:44.189 INFO:teuthology.orchestra.run.trial053.stdout:Rotating logs: 2026-02-24T15:36:44.216 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T15:36:44.217 DEBUG:teuthology.orchestra.run.trial053:> /usr/sbin/getenforce 2026-02-24T15:36:44.274 INFO:teuthology.orchestra.run.trial053.stdout:Permissive 2026-02-24T15:36:44.275 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial053.front.sepia.ceph.com': 'permissive'} 2026-02-24T15:36:44.275 DEBUG:teuthology.orchestra.run.trial053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T15:36:44.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T15:36:44.345 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T15:36:44.345 DEBUG:teuthology.orchestra.run.trial053:> sudo /usr/sbin/setenforce permissive 2026-02-24T15:36:44.413 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T15:36:44.427 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T15:36:44.435 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T15:36:44.436 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial053.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T15:39:20.966 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial053.front.sepia.ceph.com')] 2026-02-24T15:39:20.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial053.front.sepia.ceph.com' 2026-02-24T15:39:20.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T15:39:21.079 DEBUG:teuthology.orchestra.run.trial053:> true 2026-02-24T15:39:21.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial053.front.sepia.ceph.com' 2026-02-24T15:39:21.153 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T15:39:21.165 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T15:39:21.165 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T15:39:21.165 DEBUG:teuthology.orchestra.run.trial053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T15:39:21.219 INFO:teuthology.orchestra.run.trial053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T15:39:21.231 INFO:teuthology.orchestra.run.trial053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T15:39:21.253 INFO:teuthology.orchestra.run.trial053.stderr:sudo: ntpd: command not found 2026-02-24T15:39:21.262 INFO:teuthology.orchestra.run.trial053.stdout:506 Cannot talk to daemon 2026-02-24T15:39:21.274 INFO:teuthology.orchestra.run.trial053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T15:39:21.285 INFO:teuthology.orchestra.run.trial053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T15:39:21.340 INFO:teuthology.orchestra.run.trial053.stderr:bash: line 1: ntpq: command not found 2026-02-24T15:39:21.375 INFO:teuthology.orchestra.run.trial053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T15:39:21.375 INFO:teuthology.orchestra.run.trial053.stdout:=============================================================================== 2026-02-24T15:39:21.375 INFO:teuthology.orchestra.run.trial053.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T15:39:21.375 INFO:teuthology.orchestra.run.trial053.stdout:^? 159.89.45.132 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T15:39:21.375 INFO:teuthology.orchestra.run.trial053.stdout:^? arm1.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T15:39:21.375 INFO:teuthology.orchestra.run.trial053.stdout:^? 144.202.62.209.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T15:39:21.375 INFO:teuthology.run_tasks:Running task install... 2026-02-24T15:39:21.389 DEBUG:teuthology.task.install:project ceph 2026-02-24T15:39:21.389 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}} 2026-02-24T15:39:21.389 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'} 2026-02-24T15:39:21.389 INFO:teuthology.task.install:Using flavor: debug 2026-02-24T15:39:21.393 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-24T15:39:21.393 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-24T15:39:21.394 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1', 'tag': None, 'wait_for_package': False} 2026-02-24T15:39:21.394 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=d26e5c228e3cdea4d585bcd077f8513a649ab5d1 2026-02-24T15:39:21.519 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-liucm-shard-redesign-crimson-only/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/centos/9/flavors/debug/ 2026-02-24T15:39:21.519 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5343.gd26e5c22 2026-02-24T15:39:21.638 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-liucm-shard-redesign-crimson-only/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-liucm-shard-redesign-crimson-only/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-liucm-shard-redesign-crimson-only/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T15:39:21.638 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T15:39:21.638 DEBUG:teuthology.orchestra.run.trial053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T15:39:21.664 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-24T15:39:21.664 DEBUG:teuthology.orchestra.run.trial053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T15:39:21.729 DEBUG:teuthology.orchestra.run.trial053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T15:39:21.802 DEBUG:teuthology.orchestra.run.trial053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T15:39:21.865 INFO:teuthology.orchestra.run.trial053.stdout:check_obsoletes = 1 2026-02-24T15:39:21.866 DEBUG:teuthology.orchestra.run.trial053:> sudo yum clean all 2026-02-24T15:39:22.016 INFO:teuthology.orchestra.run.trial053.stdout:41 files removed 2026-02-24T15:39:22.030 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-radosgw 2026-02-24T15:39:22.309 INFO:teuthology.orchestra.run.trial053.stdout:ceph packages for x86_64 708 kB/s | 92 kB 00:00 2026-02-24T15:39:22.454 INFO:teuthology.orchestra.run.trial053.stdout:ceph noarch packages 205 kB/s | 24 kB 00:00 2026-02-24T15:39:22.587 INFO:teuthology.orchestra.run.trial053.stdout:ceph source packages 19 kB/s | 2.1 kB 00:00 2026-02-24T15:39:24.316 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.9 MB 00:01 2026-02-24T15:39:31.348 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 27 MB 00:06 2026-02-24T15:39:34.994 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 8.0 MB 00:01 2026-02-24T15:39:36.619 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-24T15:39:38.031 INFO:teuthology.orchestra.run.trial053.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-24T15:39:41.229 INFO:teuthology.orchestra.run.trial053.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T15:39:42.445 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:39:42.446 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:39:42.446 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repository Size 2026-02-24T15:39:42.446 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:39:42.446 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: ceph-radosgw x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 11 M 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout:Upgrading: 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: librados2 x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 3.3 M 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: librbd1 x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 2.7 M 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: ceph-base x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 5.1 M 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: ceph-common x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 21 M 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: ceph-selinux x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 25 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: libcephfs2 x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 860 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: libradosstriper1 x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 263 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: librgw2 x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 5.6 M 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: python3-ceph-argparse x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 45 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: python3-ceph-common x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 185 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: python3-cephfs x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 203 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: python3-rados x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 324 k 2026-02-24T15:39:42.447 INFO:teuthology.orchestra.run.trial053.stdout: python3-rbd x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 305 k 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout: python3-rgw x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 100 k 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout:Installing weak dependencies: 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout:Install 32 Packages 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout:Upgrade 2 Packages 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 60 M 2026-02-24T15:39:42.448 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:39:46.352 INFO:teuthology.orchestra.run.trial053.stdout:(1/34): ceph-base-20.3.0-5343.gd26e5c22.el9.x86 1.5 MB/s | 5.1 MB 00:03 2026-02-24T15:39:46.384 INFO:teuthology.orchestra.run.trial053.stdout:(2/34): ceph-selinux-20.3.0-5343.gd26e5c22.el9. 794 kB/s | 25 kB 00:00 2026-02-24T15:39:46.653 INFO:teuthology.orchestra.run.trial053.stdout:(3/34): libcephfs2-20.3.0-5343.gd26e5c22.el9.x8 3.1 MB/s | 860 kB 00:00 2026-02-24T15:39:46.726 INFO:teuthology.orchestra.run.trial053.stdout:(4/34): libradosstriper1-20.3.0-5343.gd26e5c22. 3.5 MB/s | 263 kB 00:00 2026-02-24T15:39:48.222 INFO:teuthology.orchestra.run.trial053.stdout:(5/34): ceph-radosgw-20.3.0-5343.gd26e5c22.el9. 2.1 MB/s | 11 MB 00:05 2026-02-24T15:39:48.252 INFO:teuthology.orchestra.run.trial053.stdout:(6/34): python3-ceph-argparse-20.3.0-5343.gd26e 1.5 MB/s | 45 kB 00:00 2026-02-24T15:39:48.511 INFO:teuthology.orchestra.run.trial053.stdout:(7/34): python3-ceph-common-20.3.0-5343.gd26e5c 713 kB/s | 185 kB 00:00 2026-02-24T15:39:48.601 INFO:teuthology.orchestra.run.trial053.stdout:(8/34): python3-cephfs-20.3.0-5343.gd26e5c22.el 2.2 MB/s | 203 kB 00:00 2026-02-24T15:39:48.645 INFO:teuthology.orchestra.run.trial053.stdout:(9/34): librgw2-20.3.0-5343.gd26e5c22.el9.x86_6 2.9 MB/s | 5.6 MB 00:01 2026-02-24T15:39:48.688 INFO:teuthology.orchestra.run.trial053.stdout:(10/34): python3-rados-20.3.0-5343.gd26e5c22.el 3.6 MB/s | 324 kB 00:00 2026-02-24T15:39:48.721 INFO:teuthology.orchestra.run.trial053.stdout:(11/34): python3-rgw-20.3.0-5343.gd26e5c22.el9. 2.9 MB/s | 100 kB 00:00 2026-02-24T15:39:48.727 INFO:teuthology.orchestra.run.trial053.stdout:(12/34): python3-rbd-20.3.0-5343.gd26e5c22.el9. 3.6 MB/s | 305 kB 00:00 2026-02-24T15:39:48.902 INFO:teuthology.orchestra.run.trial053.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 183 kB/s | 33 kB 00:00 2026-02-24T15:39:48.920 INFO:teuthology.orchestra.run.trial053.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 484 kB/s | 93 kB 00:00 2026-02-24T15:39:48.949 INFO:teuthology.orchestra.run.trial053.stdout:(15/34): boost-program-options-1.75.0-13.el9.x8 2.2 MB/s | 104 kB 00:00 2026-02-24T15:39:48.969 INFO:teuthology.orchestra.run.trial053.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 7.7 MB/s | 160 kB 00:00 2026-02-24T15:39:48.980 INFO:teuthology.orchestra.run.trial053.stdout:(17/34): libnbd-1.20.3-4.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2026-02-24T15:39:48.980 INFO:teuthology.orchestra.run.trial053.stdout:(18/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.0 MB/s | 45 kB 00:00 2026-02-24T15:39:49.007 INFO:teuthology.orchestra.run.trial053.stdout:(19/34): librdkafka-1.6.1-102.el9.x86_64.rpm 24 MB/s | 662 kB 00:00 2026-02-24T15:39:49.012 INFO:teuthology.orchestra.run.trial053.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 10 MB/s | 292 kB 00:00 2026-02-24T15:39:49.020 INFO:teuthology.orchestra.run.trial053.stdout:(21/34): qatlib-25.08.0-2.el9.x86_64.rpm 19 MB/s | 240 kB 00:00 2026-02-24T15:39:49.021 INFO:teuthology.orchestra.run.trial053.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 2.8 MB/s | 37 kB 00:00 2026-02-24T15:39:49.031 INFO:teuthology.orchestra.run.trial053.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 6.1 MB/s | 66 kB 00:00 2026-02-24T15:39:49.455 INFO:teuthology.orchestra.run.trial053.stdout:(24/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 709 kB/s | 308 kB 00:00 2026-02-24T15:39:49.674 INFO:teuthology.orchestra.run.trial053.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 113 kB/s | 25 kB 00:00 2026-02-24T15:39:49.955 INFO:teuthology.orchestra.run.trial053.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 175 kB/s | 49 kB 00:00 2026-02-24T15:39:50.065 INFO:teuthology.orchestra.run.trial053.stdout:(27/34): libarrow-9.0.0-15.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2026-02-24T15:39:50.231 INFO:teuthology.orchestra.run.trial053.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 243 kB/s | 67 kB 00:00 2026-02-24T15:39:50.551 INFO:teuthology.orchestra.run.trial053.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 1.7 MB/s | 838 kB 00:00 2026-02-24T15:39:50.579 INFO:teuthology.orchestra.run.trial053.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 550 kB/s | 191 kB 00:00 2026-02-24T15:39:51.202 INFO:teuthology.orchestra.run.trial053.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 2.4 MB/s | 1.6 MB 00:00 2026-02-24T15:39:51.766 INFO:teuthology.orchestra.run.trial053.stdout:(32/34): ceph-common-20.3.0-5343.gd26e5c22.el9. 2.4 MB/s | 21 MB 00:08 2026-02-24T15:39:52.200 INFO:teuthology.orchestra.run.trial053.stdout:(33/34): librados2-20.3.0-5343.gd26e5c22.el9.x8 2.0 MB/s | 3.3 MB 00:01 2026-02-24T15:39:52.540 INFO:teuthology.orchestra.run.trial053.stdout:(34/34): librbd1-20.3.0-5343.gd26e5c22.el9.x86_ 2.0 MB/s | 2.7 MB 00:01 2026-02-24T15:39:52.544 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:39:52.544 INFO:teuthology.orchestra.run.trial053.stdout:Total 6.0 MB/s | 60 MB 00:10 2026-02-24T15:39:52.635 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:39:52.653 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:39:52.653 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:39:52.892 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:39:52.892 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:39:53.171 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:39:53.311 INFO:teuthology.orchestra.run.trial053.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-24T15:39:53.316 INFO:teuthology.orchestra.run.trial053.stdout: Upgrading : librados2-2:20.3.0-5343.gd26e5c22.el9.x86_64 2/36 2026-02-24T15:39:53.343 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: librados2-2:20.3.0-5343.gd26e5c22.el9.x86_64 2/36 2026-02-24T15:39:53.379 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-rados-2:20.3.0-5343.gd26e5c22.el9.x86_64 3/36 2026-02-24T15:39:53.380 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libcephfs2-2:20.3.0-5343.gd26e5c22.el9.x86_64 4/36 2026-02-24T15:39:53.392 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: libcephfs2-2:20.3.0-5343.gd26e5c22.el9.x86_64 4/36 2026-02-24T15:39:53.399 INFO:teuthology.orchestra.run.trial053.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-24T15:39:53.402 INFO:teuthology.orchestra.run.trial053.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-24T15:39:53.406 INFO:teuthology.orchestra.run.trial053.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-24T15:39:53.410 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-24T15:39:53.421 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-ceph-argparse-2:20.3.0-5343.gd26e5c22.el9. 9/36 2026-02-24T15:39:53.434 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-cephfs-2:20.3.0-5343.gd26e5c22.el9.x86_64 10/36 2026-02-24T15:39:53.434 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libradosstriper1-2:20.3.0-5343.gd26e5c22.el9.x86_6 11/36 2026-02-24T15:39:53.456 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5343.gd26e5c22.el9.x86_6 11/36 2026-02-24T15:39:53.460 INFO:teuthology.orchestra.run.trial053.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-24T15:39:53.490 INFO:teuthology.orchestra.run.trial053.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T15:39:53.493 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T15:39:53.501 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T15:39:53.503 INFO:teuthology.orchestra.run.trial053.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T15:39:53.508 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T15:39:53.622 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T15:39:53.623 INFO:teuthology.orchestra.run.trial053.stdout: Upgrading : librbd1-2:20.3.0-5343.gd26e5c22.el9.x86_64 19/36 2026-02-24T15:39:53.649 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: librbd1-2:20.3.0-5343.gd26e5c22.el9.x86_64 19/36 2026-02-24T15:39:53.654 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-rbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 20/36 2026-02-24T15:39:53.660 INFO:teuthology.orchestra.run.trial053.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T15:39:53.909 INFO:teuthology.orchestra.run.trial053.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T15:39:53.910 INFO:teuthology.orchestra.run.trial053.stdout: Installing : librgw2-2:20.3.0-5343.gd26e5c22.el9.x86_64 23/36 2026-02-24T15:39:53.927 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: librgw2-2:20.3.0-5343.gd26e5c22.el9.x86_64 23/36 2026-02-24T15:39:53.931 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-rgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 24/36 2026-02-24T15:39:53.935 INFO:teuthology.orchestra.run.trial053.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T15:39:53.938 INFO:teuthology.orchestra.run.trial053.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T15:39:53.938 INFO:teuthology.orchestra.run.trial053.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T15:39:53.957 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T15:39:53.960 INFO:teuthology.orchestra.run.trial053.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T15:39:53.994 INFO:teuthology.orchestra.run.trial053.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T15:39:53.996 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-ceph-common-2:20.3.0-5343.gd26e5c22.el9.x8 30/36 2026-02-24T15:39:54.937 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-common-2:20.3.0-5343.gd26e5c22.el9.x86_64 31/36 2026-02-24T15:39:54.939 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-common-2:20.3.0-5343.gd26e5c22.el9.x86_64 31/36 2026-02-24T15:39:55.202 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-common-2:20.3.0-5343.gd26e5c22.el9.x86_64 31/36 2026-02-24T15:39:55.205 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-base-2:20.3.0-5343.gd26e5c22.el9.x86_64 32/36 2026-02-24T15:39:55.247 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-base-2:20.3.0-5343.gd26e5c22.el9.x86_64 32/36 2026-02-24T15:39:55.247 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T15:39:55.247 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T15:39:55.247 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:39:55.249 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-selinux-2:20.3.0-5343.gd26e5c22.el9.x86_64 33/36 2026-02-24T15:39:59.788 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5343.gd26e5c22.el9.x86_64 33/36 2026-02-24T15:39:59.788 INFO:teuthology.orchestra.run.trial053.stdout:skipping the directory /sys 2026-02-24T15:39:59.788 INFO:teuthology.orchestra.run.trial053.stdout:skipping the directory /proc 2026-02-24T15:39:59.788 INFO:teuthology.orchestra.run.trial053.stdout:skipping the directory /mnt 2026-02-24T15:39:59.788 INFO:teuthology.orchestra.run.trial053.stdout:skipping the directory /var/tmp 2026-02-24T15:39:59.788 INFO:teuthology.orchestra.run.trial053.stdout:skipping the directory /home 2026-02-24T15:39:59.788 INFO:teuthology.orchestra.run.trial053.stdout:skipping the directory /root 2026-02-24T15:39:59.788 INFO:teuthology.orchestra.run.trial053.stdout:skipping the directory /tmp 2026-02-24T15:39:59.788 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:40:00.280 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-radosgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 34/36 2026-02-24T15:40:00.316 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 34/36 2026-02-24T15:40:00.316 INFO:teuthology.orchestra.run.trial053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T15:40:00.316 INFO:teuthology.orchestra.run.trial053.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T15:40:00.316 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T15:40:00.316 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T15:40:00.316 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:40:00.317 INFO:teuthology.orchestra.run.trial053.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T15:40:00.330 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T15:40:00.330 INFO:teuthology.orchestra.run.trial053.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T15:40:00.387 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T15:40:00.388 INFO:teuthology.orchestra.run.trial053.stdout:Creating group 'qat' with GID 992. 2026-02-24T15:40:00.388 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:40:00.677 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-base-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/36 2026-02-24T15:40:00.677 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-common-2:20.3.0-5343.gd26e5c22.el9.x86_64 2/36 2026-02-24T15:40:00.677 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-radosgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 3/36 2026-02-24T15:40:00.677 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-selinux-2:20.3.0-5343.gd26e5c22.el9.x86_64 4/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libcephfs2-2:20.3.0-5343.gd26e5c22.el9.x86_64 5/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libradosstriper1-2:20.3.0-5343.gd26e5c22.el9.x86_6 6/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : librgw2-2:20.3.0-5343.gd26e5c22.el9.x86_64 7/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5343.gd26e5c22.el9. 8/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-ceph-common-2:20.3.0-5343.gd26e5c22.el9.x8 9/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-cephfs-2:20.3.0-5343.gd26e5c22.el9.x86_64 10/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-rados-2:20.3.0-5343.gd26e5c22.el9.x86_64 11/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-rbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 12/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-rgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 13/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T15:40:00.678 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T15:40:00.679 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T15:40:00.679 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T15:40:00.679 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T15:40:00.679 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T15:40:00.679 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : librados2-2:20.3.0-5343.gd26e5c22.el9.x86_64 33/36 2026-02-24T15:40:00.679 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T15:40:00.679 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : librbd1-2:20.3.0-5343.gd26e5c22.el9.x86_64 35/36 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout:Upgraded: 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: librados2-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: librbd1-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: ceph-base-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: ceph-common-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: ceph-radosgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: ceph-selinux-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: libcephfs2-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T15:40:00.744 INFO:teuthology.orchestra.run.trial053.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: libradosstriper1-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: librgw2-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: python3-ceph-argparse-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: python3-ceph-common-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: python3-cephfs-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: python3-rados-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: python3-rbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: python3-rgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:40:00.745 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:40:00.786 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-test 2026-02-24T15:40:01.109 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:20 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:40:01.191 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:40:01.191 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repository Size 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: ceph-test x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 126 M 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: libcephsqlite x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 153 k 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout:Install 12 Packages 2026-02-24T15:40:01.192 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:40:01.193 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 131 M 2026-02-24T15:40:01.193 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 981 M 2026-02-24T15:40:01.193 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:40:01.706 INFO:teuthology.orchestra.run.trial053.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 7.5 MB/s | 2.1 MB 00:00 2026-02-24T15:40:01.772 INFO:teuthology.orchestra.run.trial053.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 346 kB/s | 23 kB 00:00 2026-02-24T15:40:01.859 INFO:teuthology.orchestra.run.trial053.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2026-02-24T15:40:01.884 INFO:teuthology.orchestra.run.trial053.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 21 MB/s | 525 kB 00:00 2026-02-24T15:40:01.890 INFO:teuthology.orchestra.run.trial053.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 28 MB/s | 176 kB 00:00 2026-02-24T15:40:01.896 INFO:teuthology.orchestra.run.trial053.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 37 MB/s | 233 kB 00:00 2026-02-24T15:40:01.915 INFO:teuthology.orchestra.run.trial053.stdout:(7/12): libcephsqlite-20.3.0-5343.gd26e5c22.el9 313 kB/s | 153 kB 00:00 2026-02-24T15:40:01.923 INFO:teuthology.orchestra.run.trial053.stdout:(8/12): protobuf-3.14.0-17.el9.x86_64.rpm 37 MB/s | 1.0 MB 00:00 2026-02-24T15:40:01.928 INFO:teuthology.orchestra.run.trial053.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-24T15:40:01.937 INFO:teuthology.orchestra.run.trial053.stdout:(10/12): socat-1.7.4.1-8.el9.x86_64.rpm 14 MB/s | 303 kB 00:00 2026-02-24T15:40:02.365 INFO:teuthology.orchestra.run.trial053.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 280 kB/s | 122 kB 00:00 2026-02-24T15:42:05.378 INFO:teuthology.orchestra.run.trial053.stdout:(12/12): ceph-test-20.3.0-5343.gd26e5c22.el9.x8 1.0 MB/s | 126 MB 02:03 2026-02-24T15:42:05.380 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:42:05.380 INFO:teuthology.orchestra.run.trial053.stdout:Total 1.1 MB/s | 131 MB 02:04 2026-02-24T15:42:05.451 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:42:05.461 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:42:05.462 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:42:05.890 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:42:05.890 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:42:06.344 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:42:06.352 INFO:teuthology.orchestra.run.trial053.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-24T15:42:06.361 INFO:teuthology.orchestra.run.trial053.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-24T15:42:06.365 INFO:teuthology.orchestra.run.trial053.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-24T15:42:06.371 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-24T15:42:06.373 INFO:teuthology.orchestra.run.trial053.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-24T15:42:06.377 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-24T15:42:06.378 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T15:42:06.396 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-24T15:42:06.400 INFO:teuthology.orchestra.run.trial053.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-24T15:42:06.412 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-24T15:42:06.420 INFO:teuthology.orchestra.run.trial053.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-24T15:42:06.421 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libcephsqlite-2:20.3.0-5343.gd26e5c22.el9.x86_64 11/12 2026-02-24T15:42:13.359 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5343.gd26e5c22.el9.x86_64 11/12 2026-02-24T15:42:13.378 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-test-2:20.3.0-5343.gd26e5c22.el9.x86_64 12/12 2026-02-24T15:42:14.145 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-test-2:20.3.0-5343.gd26e5c22.el9.x86_64 12/12 2026-02-24T15:42:14.145 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-test-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/12 2026-02-24T15:42:14.145 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libcephsqlite-2:20.3.0-5343.gd26e5c22.el9.x86_64 2/12 2026-02-24T15:42:14.146 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-24T15:42:14.146 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-24T15:42:14.146 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-24T15:42:14.146 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-24T15:42:14.146 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-24T15:42:14.146 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-24T15:42:14.146 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-24T15:42:14.146 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-24T15:42:14.146 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-24T15:42:14.204 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-24T15:42:14.204 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:42:14.204 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:42:14.205 INFO:teuthology.orchestra.run.trial053.stdout: ceph-test-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:42:14.205 INFO:teuthology.orchestra.run.trial053.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-24T15:42:14.205 INFO:teuthology.orchestra.run.trial053.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-24T15:42:14.205 INFO:teuthology.orchestra.run.trial053.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-24T15:42:14.205 INFO:teuthology.orchestra.run.trial053.stdout: libcephsqlite-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:42:14.205 INFO:teuthology.orchestra.run.trial053.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-24T15:42:14.205 INFO:teuthology.orchestra.run.trial053.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T15:42:14.205 INFO:teuthology.orchestra.run.trial053.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-24T15:42:14.206 INFO:teuthology.orchestra.run.trial053.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T15:42:14.206 INFO:teuthology.orchestra.run.trial053.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T15:42:14.206 INFO:teuthology.orchestra.run.trial053.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T15:42:14.206 INFO:teuthology.orchestra.run.trial053.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-24T15:42:14.206 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:42:14.206 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:42:14.245 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph 2026-02-24T15:42:14.564 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:02:33 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:42:14.648 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repository Size 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout: ceph x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 6.5 k 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mds x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 2.0 M 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 937 k 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5343.gd26e5c22.el9 ceph-noarch 297 k 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mon x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 4.9 M 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout: ceph-osd x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 163 k 2026-02-24T15:42:14.650 INFO:teuthology.orchestra.run.trial053.stdout: ceph-osd-classic x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 15 M 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: ceph-osd-crimson x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 88 M 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T15:42:14.651 INFO:teuthology.orchestra.run.trial053.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-collections 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T15:42:14.652 INFO:teuthology.orchestra.run.trial053.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:42:14.653 INFO:teuthology.orchestra.run.trial053.stdout:Install 42 Packages 2026-02-24T15:42:14.654 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:42:14.654 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 115 M 2026-02-24T15:42:14.654 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 974 M 2026-02-24T15:42:14.655 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:42:15.251 INFO:teuthology.orchestra.run.trial053.stdout:(1/42): ceph-20.3.0-5343.gd26e5c22.el9.x86_64.r 24 kB/s | 6.5 kB 00:00 2026-02-24T15:42:16.434 INFO:teuthology.orchestra.run.trial053.stdout:(2/42): ceph-mgr-20.3.0-5343.gd26e5c22.el9.x86_ 644 kB/s | 937 kB 00:01 2026-02-24T15:42:16.569 INFO:teuthology.orchestra.run.trial053.stdout:(3/42): ceph-osd-20.3.0-5343.gd26e5c22.el9.x86_ 1.2 MB/s | 163 kB 00:00 2026-02-24T15:42:17.190 INFO:teuthology.orchestra.run.trial053.stdout:(4/42): ceph-mds-20.3.0-5343.gd26e5c22.el9.x86_ 936 kB/s | 2.0 MB 00:02 2026-02-24T15:42:21.464 INFO:teuthology.orchestra.run.trial053.stdout:(5/42): ceph-mon-20.3.0-5343.gd26e5c22.el9.x86_ 802 kB/s | 4.9 MB 00:06 2026-02-24T15:42:21.816 INFO:teuthology.orchestra.run.trial053.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5343.gd26e 844 kB/s | 297 kB 00:00 2026-02-24T15:42:21.827 INFO:teuthology.orchestra.run.trial053.stdout:(7/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 3.7 MB/s | 40 kB 00:00 2026-02-24T15:42:21.835 INFO:teuthology.orchestra.run.trial053.stdout:(8/42): libconfig-1.7.2-9.el9.x86_64.rpm 9.3 MB/s | 72 kB 00:00 2026-02-24T15:42:21.845 INFO:teuthology.orchestra.run.trial053.stdout:(9/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 25 MB/s | 253 kB 00:00 2026-02-24T15:42:21.879 INFO:teuthology.orchestra.run.trial053.stdout:(10/42): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-24T15:42:21.885 INFO:teuthology.orchestra.run.trial053.stdout:(11/42): python3-ply-3.11-14.el9.noarch.rpm 18 MB/s | 106 kB 00:00 2026-02-24T15:42:21.891 INFO:teuthology.orchestra.run.trial053.stdout:(12/42): python3-pycparser-2.20-6.el9.noarch.rp 21 MB/s | 135 kB 00:00 2026-02-24T15:42:21.898 INFO:teuthology.orchestra.run.trial053.stdout:(13/42): python3-pyparsing-2.4.7-9.el9.noarch.r 23 MB/s | 150 kB 00:00 2026-02-24T15:42:21.904 INFO:teuthology.orchestra.run.trial053.stdout:(14/42): python3-requests-2.25.1-10.el9.noarch. 19 MB/s | 126 kB 00:00 2026-02-24T15:42:21.911 INFO:teuthology.orchestra.run.trial053.stdout:(15/42): python3-urllib3-1.26.5-7.el9.noarch.rp 32 MB/s | 218 kB 00:00 2026-02-24T15:42:21.918 INFO:teuthology.orchestra.run.trial053.stdout:(16/42): unzip-6.0-59.el9.x86_64.rpm 26 MB/s | 182 kB 00:00 2026-02-24T15:42:21.924 INFO:teuthology.orchestra.run.trial053.stdout:(17/42): zip-3.0-35.el9.x86_64.rpm 41 MB/s | 266 kB 00:00 2026-02-24T15:42:21.932 INFO:teuthology.orchestra.run.trial053.stdout:(18/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 31 MB/s | 246 kB 00:00 2026-02-24T15:42:21.938 INFO:teuthology.orchestra.run.trial053.stdout:(19/42): lua-5.4.4-4.el9.x86_64.rpm 31 MB/s | 188 kB 00:00 2026-02-24T15:42:21.946 INFO:teuthology.orchestra.run.trial053.stdout:(20/42): python3-libstoragemgmt-1.10.1-1.el9.x8 23 MB/s | 177 kB 00:00 2026-02-24T15:42:21.951 INFO:teuthology.orchestra.run.trial053.stdout:(21/42): python3-packaging-20.9-5.el9.noarch.rp 14 MB/s | 77 kB 00:00 2026-02-24T15:42:21.956 INFO:teuthology.orchestra.run.trial053.stdout:(22/42): python3-toml-0.10.2-6.el9.noarch.rpm 8.6 MB/s | 42 kB 00:00 2026-02-24T15:42:22.398 INFO:teuthology.orchestra.run.trial053.stdout:(23/42): lua-devel-5.4.4-4.el9.x86_64.rpm 50 kB/s | 22 kB 00:00 2026-02-24T15:42:22.625 INFO:teuthology.orchestra.run.trial053.stdout:(24/42): luarocks-3.9.2-5.el9.noarch.rpm 668 kB/s | 151 kB 00:00 2026-02-24T15:42:22.694 INFO:teuthology.orchestra.run.trial053.stdout:(25/42): python3-autocommand-2.2.2-8.el9.noarch 424 kB/s | 29 kB 00:00 2026-02-24T15:42:22.755 INFO:teuthology.orchestra.run.trial053.stdout:(26/42): python3-backports-tarfile-1.2.0-1.el9. 999 kB/s | 60 kB 00:00 2026-02-24T15:42:22.946 INFO:teuthology.orchestra.run.trial053.stdout:(27/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 227 kB/s | 43 kB 00:00 2026-02-24T15:42:23.029 INFO:teuthology.orchestra.run.trial053.stdout:(28/42): python3-cheroot-10.0.1-4.el9.noarch.rp 2.0 MB/s | 173 kB 00:00 2026-02-24T15:42:23.122 INFO:teuthology.orchestra.run.trial053.stdout:(29/42): python3-cherrypy-18.6.1-2.el9.noarch.r 3.8 MB/s | 358 kB 00:00 2026-02-24T15:42:23.175 INFO:teuthology.orchestra.run.trial053.stdout:(30/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 203 kB/s | 11 kB 00:00 2026-02-24T15:42:23.211 INFO:teuthology.orchestra.run.trial053.stdout:(31/42): python3-jaraco-classes-3.2.1-5.el9.noa 485 kB/s | 18 kB 00:00 2026-02-24T15:42:23.248 INFO:teuthology.orchestra.run.trial053.stdout:(32/42): python3-jaraco-collections-3.0.0-8.el9 631 kB/s | 23 kB 00:00 2026-02-24T15:42:23.305 INFO:teuthology.orchestra.run.trial053.stdout:(33/42): python3-jaraco-context-6.0.1-3.el9.noa 342 kB/s | 20 kB 00:00 2026-02-24T15:42:23.342 INFO:teuthology.orchestra.run.trial053.stdout:(34/42): python3-jaraco-functools-3.5.0-2.el9.n 529 kB/s | 19 kB 00:00 2026-02-24T15:42:23.398 INFO:teuthology.orchestra.run.trial053.stdout:(35/42): python3-jaraco-text-4.0.0-2.el9.noarch 474 kB/s | 26 kB 00:00 2026-02-24T15:42:23.460 INFO:teuthology.orchestra.run.trial053.stdout:(36/42): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2026-02-24T15:42:23.500 INFO:teuthology.orchestra.run.trial053.stdout:(37/42): python3-portend-3.1.0-2.el9.noarch.rpm 418 kB/s | 16 kB 00:00 2026-02-24T15:42:23.567 INFO:teuthology.orchestra.run.trial053.stdout:(38/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2026-02-24T15:42:23.625 INFO:teuthology.orchestra.run.trial053.stdout:(39/42): python3-tempora-5.0.0-2.el9.noarch.rpm 614 kB/s | 36 kB 00:00 2026-02-24T15:42:23.682 INFO:teuthology.orchestra.run.trial053.stdout:(40/42): python3-zc-lockfile-2.0-10.el9.noarch. 346 kB/s | 20 kB 00:00 2026-02-24T15:42:33.341 INFO:teuthology.orchestra.run.trial053.stdout:(41/42): ceph-osd-classic-20.3.0-5343.gd26e5c22 901 kB/s | 15 MB 00:16 2026-02-24T15:43:50.953 INFO:teuthology.orchestra.run.trial053.stdout:(42/42): ceph-osd-crimson-20.3.0-5343.gd26e5c22 959 kB/s | 88 MB 01:33 2026-02-24T15:43:50.955 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:43:50.956 INFO:teuthology.orchestra.run.trial053.stdout:Total 1.2 MB/s | 115 MB 01:36 2026-02-24T15:43:51.077 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:43:51.097 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:43:51.097 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:43:51.496 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:43:51.496 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:43:51.929 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:43:51.931 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-24T15:43:51.936 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-24T15:43:51.941 INFO:teuthology.orchestra.run.trial053.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-24T15:43:51.943 INFO:teuthology.orchestra.run.trial053.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-24T15:43:51.949 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-24T15:43:51.973 INFO:teuthology.orchestra.run.trial053.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-24T15:43:51.977 INFO:teuthology.orchestra.run.trial053.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-24T15:43:51.982 INFO:teuthology.orchestra.run.trial053.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-24T15:43:51.987 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-24T15:43:51.993 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-24T15:43:51.997 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-24T15:43:52.003 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-24T15:43:52.008 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-24T15:43:52.012 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-24T15:43:52.017 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-24T15:43:52.021 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-24T15:43:52.028 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-24T15:43:52.031 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-24T15:43:52.054 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-24T15:43:52.067 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-24T15:43:52.072 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-24T15:43:52.082 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-24T15:43:52.088 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-24T15:43:52.101 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-24T15:43:52.117 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-24T15:43:52.192 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-24T15:43:52.201 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-24T15:43:52.224 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-24T15:43:52.253 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-24T15:43:52.259 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-24T15:43:52.311 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-24T15:43:52.351 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5343.gd26e5c22.el9. 32/42 2026-02-24T15:43:52.352 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-mgr-2:20.3.0-5343.gd26e5c22.el9.x86_64 33/42 2026-02-24T15:43:52.377 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5343.gd26e5c22.el9.x86_64 33/42 2026-02-24T15:43:52.377 INFO:teuthology.orchestra.run.trial053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T15:43:52.377 INFO:teuthology.orchestra.run.trial053.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T15:43:52.377 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T15:43:52.377 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T15:43:52.378 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:43:52.382 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-24T15:43:52.398 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-24T15:43:52.398 INFO:teuthology.orchestra.run.trial053.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T15:43:52.398 INFO:teuthology.orchestra.run.trial053.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T15:43:52.398 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:43:52.406 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-24T15:43:52.429 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-24T15:43:52.429 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T15:43:52.429 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:43:53.031 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-24T15:43:58.465 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-osd-classic-2:20.3.0-5343.gd26e5c22.el9.x86_6 37/42 2026-02-24T15:43:58.475 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-osd-crimson-2:20.3.0-5343.gd26e5c22.el9.x86_6 38/42 2026-02-24T15:43:58.476 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-osd-2:20.3.0-5343.gd26e5c22.el9.x86_64 39/42 2026-02-24T15:43:58.499 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-osd-2:20.3.0-5343.gd26e5c22.el9.x86_64 39/42 2026-02-24T15:43:58.500 INFO:teuthology.orchestra.run.trial053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T15:43:58.500 INFO:teuthology.orchestra.run.trial053.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T15:43:58.500 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T15:43:58.500 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T15:43:58.500 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:43:58.707 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-mon-2:20.3.0-5343.gd26e5c22.el9.x86_64 40/42 2026-02-24T15:43:58.728 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-mon-2:20.3.0-5343.gd26e5c22.el9.x86_64 40/42 2026-02-24T15:43:58.728 INFO:teuthology.orchestra.run.trial053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T15:43:58.728 INFO:teuthology.orchestra.run.trial053.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T15:43:58.728 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T15:43:58.729 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T15:43:58.729 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:43:58.810 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-mds-2:20.3.0-5343.gd26e5c22.el9.x86_64 41/42 2026-02-24T15:43:58.830 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-mds-2:20.3.0-5343.gd26e5c22.el9.x86_64 41/42 2026-02-24T15:43:58.830 INFO:teuthology.orchestra.run.trial053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T15:43:58.831 INFO:teuthology.orchestra.run.trial053.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T15:43:58.831 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T15:43:58.831 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T15:43:58.831 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:43:58.832 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-2:20.3.0-5343.gd26e5c22.el9.x86_64 42/42 2026-02-24T15:43:58.838 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5343.gd26e5c22.el9.x86_6 42/42 2026-02-24T15:43:58.861 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5343.gd26e5c22.el9.x86_6 42/42 2026-02-24T15:43:59.845 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-2:20.3.0-5343.gd26e5c22.el9.x86_64 42/42 2026-02-24T15:43:59.845 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/42 2026-02-24T15:43:59.845 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-mds-2:20.3.0-5343.gd26e5c22.el9.x86_64 2/42 2026-02-24T15:43:59.845 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-mgr-2:20.3.0-5343.gd26e5c22.el9.x86_64 3/42 2026-02-24T15:43:59.845 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-mon-2:20.3.0-5343.gd26e5c22.el9.x86_64 4/42 2026-02-24T15:43:59.845 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-osd-2:20.3.0-5343.gd26e5c22.el9.x86_64 5/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-osd-classic-2:20.3.0-5343.gd26e5c22.el9.x86_6 6/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5343.gd26e5c22.el9.x86_6 7/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5343.gd26e5c22.el9. 8/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-24T15:43:59.846 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-24T15:43:59.847 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-24T15:43:59.848 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-24T15:43:59.849 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-24T15:43:59.849 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-24T15:43:59.906 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: ceph-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mds-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-modules-core-2:20.3.0-5343.gd26e5c22.el9.noarch 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mon-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: ceph-osd-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: ceph-osd-classic-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: ceph-osd-crimson-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:43:59.907 INFO:teuthology.orchestra.run.trial053.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T15:43:59.908 INFO:teuthology.orchestra.run.trial053.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T15:43:59.909 INFO:teuthology.orchestra.run.trial053.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: zip-3.0-35.el9.x86_64 2026-02-24T15:43:59.910 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:43:59.911 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:43:59.954 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-base 2026-02-24T15:44:00.278 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:04:19 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:44:00.344 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-base-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:44:00.362 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:44:00.363 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:44:00.363 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:44:00.385 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install cephadm 2026-02-24T15:44:00.702 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:04:19 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:44:00.785 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:44:00.785 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:44:00.785 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repository Size 2026-02-24T15:44:00.785 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:44:00.785 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:44:00.785 INFO:teuthology.orchestra.run.trial053.stdout: cephadm noarch 2:20.3.0-5343.gd26e5c22.el9 ceph-noarch 1.0 M 2026-02-24T15:44:00.785 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:00.785 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:44:00.786 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:44:00.786 INFO:teuthology.orchestra.run.trial053.stdout:Install 1 Package 2026-02-24T15:44:00.786 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:00.786 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 1.0 M 2026-02-24T15:44:00.786 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 1.0 M 2026-02-24T15:44:00.786 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:44:03.166 INFO:teuthology.orchestra.run.trial053.stdout:cephadm-20.3.0-5343.gd26e5c22.el9.noarch.rpm 437 kB/s | 1.0 MB 00:02 2026-02-24T15:44:03.167 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:44:03.167 INFO:teuthology.orchestra.run.trial053.stdout:Total 437 kB/s | 1.0 MB 00:02 2026-02-24T15:44:03.167 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:44:03.171 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:44:03.171 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:44:03.175 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:44:03.175 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:44:03.194 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:44:03.254 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch 1/1 2026-02-24T15:44:03.268 INFO:teuthology.orchestra.run.trial053.stdout: Installing : cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch 1/1 2026-02-24T15:44:03.335 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch 1/1 2026-02-24T15:44:03.396 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch 1/1 2026-02-24T15:44:03.396 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:03.396 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:44:03.396 INFO:teuthology.orchestra.run.trial053.stdout: cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch 2026-02-24T15:44:03.396 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:03.396 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:44:03.424 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T15:44:03.741 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:04:22 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:44:03.824 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:44:03.826 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:44:03.826 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repo Size 2026-02-24T15:44:03.826 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:44:03.826 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:44:03.826 INFO:teuthology.orchestra.run.trial053.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 149 k 2026-02-24T15:44:03.826 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:03.827 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:44:03.827 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:44:03.827 INFO:teuthology.orchestra.run.trial053.stdout:Install 1 Package 2026-02-24T15:44:03.827 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:03.827 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 149 k 2026-02-24T15:44:03.827 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 455 k 2026-02-24T15:44:03.827 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:44:04.383 INFO:teuthology.orchestra.run.trial053.stdout:ceph-immutable-object-cache-20.3.0-5343.gd26e5c 268 kB/s | 149 kB 00:00 2026-02-24T15:44:04.384 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:44:04.384 INFO:teuthology.orchestra.run.trial053.stdout:Total 268 kB/s | 149 kB 00:00 2026-02-24T15:44:04.384 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:44:04.388 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:44:04.388 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:44:04.414 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:44:04.414 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:44:04.463 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:44:04.465 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5343.gd26e5c22. 1/1 2026-02-24T15:44:04.486 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5343.gd26e5c22. 1/1 2026-02-24T15:44:04.486 INFO:teuthology.orchestra.run.trial053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T15:44:04.486 INFO:teuthology.orchestra.run.trial053.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T15:44:04.486 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:04.797 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5343.gd26e5c22. 1/1 2026-02-24T15:44:04.798 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:04.798 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:44:04.798 INFO:teuthology.orchestra.run.trial053.stdout: ceph-immutable-object-cache-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:44:04.798 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:04.798 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:44:04.826 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr 2026-02-24T15:44:05.147 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:04:24 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:44:05.212 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-mgr-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:44:05.229 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:44:05.230 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:44:05.230 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:44:05.252 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T15:44:05.568 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:04:24 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:44:05.652 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:44:05.653 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:44:05.653 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repository Size 2026-02-24T15:44:05.653 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:44:05.653 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:44:05.653 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5343.gd26e5c22.el9 ceph-noarch 51 M 2026-02-24T15:44:05.653 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:44:05.653 INFO:teuthology.orchestra.run.trial053.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5343.gd26e5c22.el9 ceph-noarch 57 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5343.gd26e5c22.el9 ceph-noarch 17 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout:Install 13 Packages 2026-02-24T15:44:05.654 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:44:05.655 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 55 M 2026-02-24T15:44:05.655 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 262 M 2026-02-24T15:44:05.655 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:44:06.339 INFO:teuthology.orchestra.run.trial053.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5343.gd26 49 kB/s | 17 kB 00:00 2026-02-24T15:44:06.412 INFO:teuthology.orchestra.run.trial053.stdout:(2/13): ceph-grafana-dashboards-20.3.0-5343.gd2 135 kB/s | 57 kB 00:00 2026-02-24T15:44:06.706 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-jmespath-1.0.1-1.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jmespath-1.0.1-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:06.751 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-protobuf-3.14.0-17.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-protobuf-3.14.0-17.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:07.108 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-jmespath-1.0.1-1.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jmespath-1.0.1-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:07.156 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-protobuf-3.14.0-17.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-protobuf-3.14.0-17.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:07.433 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-jmespath-1.0.1-1.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jmespath-1.0.1-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:07.481 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-protobuf-3.14.0-17.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-protobuf-3.14.0-17.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:07.790 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-jmespath-1.0.1-1.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jmespath-1.0.1-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:07.810 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-protobuf-3.14.0-17.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-protobuf-3.14.0-17.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:08.271 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-jmespath-1.0.1-1.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jmespath-1.0.1-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:08.298 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-protobuf-3.14.0-17.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-protobuf-3.14.0-17.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:08.912 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-jmespath-1.0.1-1.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-jmespath-1.0.1-1.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:08.937 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-protobuf-3.14.0-17.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-protobuf-3.14.0-17.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:44:09.498 INFO:teuthology.orchestra.run.trial053.stdout:(3/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 15 kB/s | 48 kB 00:03 2026-02-24T15:44:09.711 INFO:teuthology.orchestra.run.trial053.stdout:(4/13): python3-protobuf-3.14.0-17.el9.noarch.r 81 kB/s | 267 kB 00:03 2026-02-24T15:44:09.949 INFO:teuthology.orchestra.run.trial053.stdout:(5/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.3 MB/s | 551 kB 00:00 2026-02-24T15:44:09.984 INFO:teuthology.orchestra.run.trial053.stdout:(6/13): grpc-data-1.46.7-10.el9.noarch.rpm 571 kB/s | 19 kB 00:00 2026-02-24T15:44:10.126 INFO:teuthology.orchestra.run.trial053.stdout:(7/13): python3-grpcio-1.46.7-10.el9.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2026-02-24T15:44:10.163 INFO:teuthology.orchestra.run.trial053.stdout:(8/13): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.9 MB/s | 144 kB 00:00 2026-02-24T15:44:10.198 INFO:teuthology.orchestra.run.trial053.stdout:(9/13): python3-repoze-lru-0.7-16.el9.noarch.rp 892 kB/s | 31 kB 00:00 2026-02-24T15:44:10.235 INFO:teuthology.orchestra.run.trial053.stdout:(10/13): python3-routes-2.5.1-5.el9.noarch.rpm 4.9 MB/s | 188 kB 00:00 2026-02-24T15:44:10.269 INFO:teuthology.orchestra.run.trial053.stdout:(11/13): python3-xmltodict-0.12.0-15.el9.noarch 642 kB/s | 22 kB 00:00 2026-02-24T15:44:10.406 INFO:teuthology.orchestra.run.trial053.stdout:(12/13): protobuf-compiler-3.14.0-17.el9.x86_64 949 kB/s | 862 kB 00:00 2026-02-24T15:45:27.733 INFO:teuthology.orchestra.run.trial053.stdout:(13/13): ceph-mgr-dashboard-20.3.0-5343.gd26e5c 635 kB/s | 51 MB 01:21 2026-02-24T15:45:27.737 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:45:27.737 INFO:teuthology.orchestra.run.trial053.stdout:Total 684 kB/s | 55 MB 01:22 2026-02-24T15:45:27.762 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:45:27.771 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:45:27.772 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:45:27.986 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:45:27.986 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:45:28.217 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:45:28.223 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-24T15:45:28.234 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-24T15:45:28.237 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-24T15:45:28.266 INFO:teuthology.orchestra.run.trial053.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-24T15:45:28.310 INFO:teuthology.orchestra.run.trial053.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-24T15:45:28.318 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-24T15:45:28.347 INFO:teuthology.orchestra.run.trial053.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-24T15:45:28.356 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-24T15:45:28.363 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-24T15:45:28.366 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-24T15:45:28.375 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5343.gd26e5c22.el9 11/13 2026-02-24T15:45:31.258 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5343.gd26e5c22.el 12/13 2026-02-24T15:45:31.265 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5343.gd26e5c22.el9.noa 13/13 2026-02-24T15:45:31.533 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5343.gd26e5c22.el9.noa 13/13 2026-02-24T15:45:31.534 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5343.gd26e5c22.el 1/13 2026-02-24T15:45:31.534 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5343.gd26e5c22.el9.noa 2/13 2026-02-24T15:45:31.534 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5343.gd26e5c22.el9 3/13 2026-02-24T15:45:31.534 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-24T15:45:31.534 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-24T15:45:31.534 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-24T15:45:31.534 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-24T15:45:31.534 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-24T15:45:31.535 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-24T15:45:31.535 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-24T15:45:31.535 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-24T15:45:31.535 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: ceph-grafana-dashboards-2:20.3.0-5343.gd26e5c22.el9.noarch 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-dashboard-2:20.3.0-5343.gd26e5c22.el9.noarch 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: ceph-prometheus-alerts-2:20.3.0-5343.gd26e5c22.el9.noarch 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:31.593 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:45:31.628 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T15:45:31.941 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:05:50 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:45:32.024 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:45:32.026 INFO:teuthology.orchestra.run.trial053.stdout:======================================================================================= 2026-02-24T15:45:32.026 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repository Size 2026-02-24T15:45:32.026 INFO:teuthology.orchestra.run.trial053.stdout:======================================================================================= 2026-02-24T15:45:32.026 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:45:32.026 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5343.gd26e5c22.el9 ceph-noarch 7.4 M 2026-02-24T15:45:32.026 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:45:32.026 INFO:teuthology.orchestra.run.trial053.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T15:45:32.026 INFO:teuthology.orchestra.run.trial053.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T15:45:32.026 INFO:teuthology.orchestra.run.trial053.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout:======================================================================================= 2026-02-24T15:45:32.027 INFO:teuthology.orchestra.run.trial053.stdout:Install 12 Packages 2026-02-24T15:45:32.028 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:32.028 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 43 M 2026-02-24T15:45:32.028 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 234 M 2026-02-24T15:45:32.028 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:45:32.674 INFO:teuthology.orchestra.run.trial053.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 397 kB/s | 184 kB 00:00 2026-02-24T15:45:32.855 INFO:teuthology.orchestra.run.trial053.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 1.2 MB/s | 794 kB 00:00 2026-02-24T15:45:33.036 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] flexiblas-3.0.4-9.el9.x86_64.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/flexiblas-3.0.4-9.el9.x86_64.rpm (IP: 140.211.166.134) 2026-02-24T15:45:33.523 INFO:teuthology.orchestra.run.trial053.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 35 kB/s | 30 kB 00:00 2026-02-24T15:45:33.623 INFO:teuthology.orchestra.run.trial053.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 149 kB/s | 15 kB 00:00 2026-02-24T15:45:33.801 INFO:teuthology.orchestra.run.trial053.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 236 kB/s | 42 kB 00:00 2026-02-24T15:45:35.729 INFO:teuthology.orchestra.run.trial053.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 2.7 MB/s | 5.3 MB 00:01 2026-02-24T15:45:35.832 INFO:teuthology.orchestra.run.trial053.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 2.3 MB/s | 244 kB 00:00 2026-02-24T15:45:36.342 INFO:teuthology.orchestra.run.trial053.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 12 MB/s | 6.1 MB 00:00 2026-02-24T15:45:36.445 INFO:teuthology.orchestra.run.trial053.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 4.2 MB/s | 442 kB 00:00 2026-02-24T15:45:36.707 INFO:teuthology.orchestra.run.trial053.stdout:(10/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 795 kB/s | 3.0 MB 00:03 2026-02-24T15:45:38.013 INFO:teuthology.orchestra.run.trial053.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 12 MB/s | 19 MB 00:01 2026-02-24T15:45:45.804 INFO:teuthology.orchestra.run.trial053.stdout:(12/12): ceph-mgr-diskprediction-local-20.3.0-5 557 kB/s | 7.4 MB 00:13 2026-02-24T15:45:45.806 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:45:45.807 INFO:teuthology.orchestra.run.trial053.stdout:Total 3.1 MB/s | 43 MB 00:13 2026-02-24T15:45:45.962 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:45:45.976 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:45:45.977 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:45:46.178 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:45:46.178 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:45:46.396 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:45:46.399 INFO:teuthology.orchestra.run.trial053.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T15:45:46.405 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T15:45:46.438 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T15:45:46.443 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T15:45:46.502 INFO:teuthology.orchestra.run.trial053.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T15:45:46.504 INFO:teuthology.orchestra.run.trial053.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T15:45:46.525 INFO:teuthology.orchestra.run.trial053.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T15:45:46.843 INFO:teuthology.orchestra.run.trial053.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T15:45:46.915 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T15:45:47.571 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T15:45:48.040 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T15:45:48.041 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5343.gd26e5 12/12 2026-02-24T15:45:48.342 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5343.gd26e5 12/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5343.gd26e5 1/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T15:45:48.343 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T15:45:48.405 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T15:45:48.405 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:48.405 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5343.gd26e5c22.el9.noarch 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T15:45:48.406 INFO:teuthology.orchestra.run.trial053.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T15:45:48.407 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:48.407 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:45:48.443 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr-rook 2026-02-24T15:45:48.762 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:07 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:45:48.846 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:45:48.847 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:45:48.847 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repository Size 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-rook noarch 2:20.3.0-5343.gd26e5c22.el9 ceph-noarch 50 k 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T15:45:48.848 INFO:teuthology.orchestra.run.trial053.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout:Install 10 Packages 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 2.0 M 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 25 M 2026-02-24T15:45:48.849 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:45:49.924 INFO:teuthology.orchestra.run.trial053.stdout:(1/10): ceph-mgr-rook-20.3.0-5343.gd26e5c22.el9 122 kB/s | 50 kB 00:00 2026-02-24T15:45:49.992 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-pyasn1-0.4.8-7.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-0.4.8-7.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:49.997 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-pyasn1-modules-0.4.8-7.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-modules-0.4.8-7.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:50.324 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-requests-oauthlib-1.3.0-12.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-requests-oauthlib-1.3.0-12.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:50.633 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-pyasn1-0.4.8-7.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-0.4.8-7.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:50.637 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-pyasn1-modules-0.4.8-7.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-modules-0.4.8-7.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:50.728 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-requests-oauthlib-1.3.0-12.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-requests-oauthlib-1.3.0-12.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:50.960 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-pyasn1-0.4.8-7.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-0.4.8-7.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:50.970 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-pyasn1-modules-0.4.8-7.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-modules-0.4.8-7.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:51.207 INFO:teuthology.orchestra.run.trial053.stdout:(2/10): python3-requests-oauthlib-1.3.0-12.el9. 42 kB/s | 54 kB 00:01 2026-02-24T15:45:51.233 INFO:teuthology.orchestra.run.trial053.stdout:(3/10): python3-cachetools-4.2.4-1.el9.noarch.r 1.2 MB/s | 32 kB 00:00 2026-02-24T15:45:51.239 INFO:teuthology.orchestra.run.trial053.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 2.3 MB/s | 14 kB 00:00 2026-02-24T15:45:51.258 INFO:teuthology.orchestra.run.trial053.stdout:(5/10): python3-google-auth-2.45.0-1.el9.noarch 13 MB/s | 254 kB 00:00 2026-02-24T15:45:51.284 INFO:teuthology.orchestra.run.trial053.stdout:(6/10): python3-kubernetes-26.1.0-3.el9.noarch. 39 MB/s | 1.0 MB 00:00 2026-02-24T15:45:51.290 INFO:teuthology.orchestra.run.trial053.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 9.8 MB/s | 59 kB 00:00 2026-02-24T15:45:51.297 INFO:teuthology.orchestra.run.trial053.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 14 MB/s | 90 kB 00:00 2026-02-24T15:45:51.299 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-pyasn1-0.4.8-7.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-0.4.8-7.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:51.309 INFO:teuthology.orchestra.run.trial053.stdout:[MIRROR] python3-pyasn1-modules-0.4.8-7.el9.noarch.rpm: Status code: 503 for https://ftp2.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-pyasn1-modules-0.4.8-7.el9.noarch.rpm (IP: 140.211.166.134) 2026-02-24T15:45:51.318 INFO:teuthology.orchestra.run.trial053.stdout:(9/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 87 kB/s | 157 kB 00:01 2026-02-24T15:45:51.330 INFO:teuthology.orchestra.run.trial053.stdout:(10/10): python3-pyasn1-modules-0.4.8-7.el9.noa 152 kB/s | 277 kB 00:01 2026-02-24T15:45:51.332 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:45:51.332 INFO:teuthology.orchestra.run.trial053.stdout:Total 818 kB/s | 2.0 MB 00:02 2026-02-24T15:45:51.358 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:45:51.366 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:45:51.366 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:45:51.406 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:45:51.406 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:45:51.483 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:45:51.534 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T15:45:51.546 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T15:45:51.561 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T15:45:51.566 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T15:45:51.573 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T15:45:51.613 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T15:45:51.625 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T15:45:51.944 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T15:45:51.959 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T15:45:51.960 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-mgr-rook-2:20.3.0-5343.gd26e5c22.el9.noarch 10/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5343.gd26e5c22.el9.noarch 10/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5343.gd26e5c22.el9.noarch 1/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T15:45:52.077 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T15:45:52.139 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T15:45:52.139 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:52.139 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:45:52.139 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-rook-2:20.3.0-5343.gd26e5c22.el9.noarch 2026-02-24T15:45:52.139 INFO:teuthology.orchestra.run.trial053.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:52.140 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:45:52.171 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T15:45:52.490 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:11 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:45:52.575 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:45:52.575 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:45:52.575 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repository Size 2026-02-24T15:45:52.575 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5343.gd26e5c22.el9 ceph-noarch 184 k 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout:Install 7 Packages 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 7.1 M 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 34 M 2026-02-24T15:45:52.576 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:45:53.629 INFO:teuthology.orchestra.run.trial053.stdout:(1/7): ceph-mgr-cephadm-20.3.0-5343.gd26e5c22.e 315 kB/s | 184 kB 00:00 2026-02-24T15:45:53.799 INFO:teuthology.orchestra.run.trial053.stdout:(2/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 330 kB/s | 249 kB 00:00 2026-02-24T15:45:53.986 INFO:teuthology.orchestra.run.trial053.stdout:(3/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.9 MB/s | 548 kB 00:00 2026-02-24T15:45:54.027 INFO:teuthology.orchestra.run.trial053.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2026-02-24T15:45:54.047 INFO:teuthology.orchestra.run.trial053.stdout:(5/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 83 kB/s | 35 kB 00:00 2026-02-24T15:45:54.049 INFO:teuthology.orchestra.run.trial053.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 3.8 MB/s | 86 kB 00:00 2026-02-24T15:45:58.200 INFO:teuthology.orchestra.run.trial053.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 1.2 MB/s | 6.0 MB 00:05 2026-02-24T15:45:58.203 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:45:58.203 INFO:teuthology.orchestra.run.trial053.stdout:Total 1.3 MB/s | 7.1 MB 00:05 2026-02-24T15:45:58.239 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:45:58.245 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:45:58.246 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:45:58.318 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:45:58.318 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:45:58.409 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:45:58.457 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T15:45:58.467 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T15:45:58.472 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T15:45:58.691 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T15:45:58.714 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T15:45:58.738 INFO:teuthology.orchestra.run.trial053.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T15:45:58.739 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch 7/7 2026-02-24T15:45:58.859 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch 7/7 2026-02-24T15:45:58.859 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch 1/7 2026-02-24T15:45:58.860 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T15:45:58.860 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T15:45:58.860 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T15:45:58.860 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T15:45:58.860 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T15:45:58.921 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T15:45:58.921 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:58.921 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:45:58.921 INFO:teuthology.orchestra.run.trial053.stdout: ceph-mgr-cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch 2026-02-24T15:45:58.921 INFO:teuthology.orchestra.run.trial053.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T15:45:58.922 INFO:teuthology.orchestra.run.trial053.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T15:45:58.922 INFO:teuthology.orchestra.run.trial053.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T15:45:58.922 INFO:teuthology.orchestra.run.trial053.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T15:45:58.922 INFO:teuthology.orchestra.run.trial053.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T15:45:58.922 INFO:teuthology.orchestra.run.trial053.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T15:45:58.922 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:45:58.922 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:45:58.952 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-osd 2026-02-24T15:45:59.272 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:18 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:45:59.337 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-osd-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:45:59.355 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:45:59.356 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:45:59.356 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:45:59.377 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-osd-classic 2026-02-24T15:45:59.689 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:18 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:45:59.754 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-osd-classic-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:45:59.772 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:45:59.773 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:45:59.773 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:45:59.794 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-fuse 2026-02-24T15:46:00.109 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:19 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:00.192 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repo Size 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout: ceph-fuse x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 914 k 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout:Install 1 Package 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 914 k 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 2.9 M 2026-02-24T15:46:00.193 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:46:04.220 INFO:teuthology.orchestra.run.trial053.stdout:ceph-fuse-20.3.0-5343.gd26e5c22.el9.x86_64.rpm 227 kB/s | 914 kB 00:04 2026-02-24T15:46:04.221 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:46:04.221 INFO:teuthology.orchestra.run.trial053.stdout:Total 227 kB/s | 914 kB 00:04 2026-02-24T15:46:04.221 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:46:04.226 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:46:04.226 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:46:04.259 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:46:04.259 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:46:04.348 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:46:04.365 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:04.589 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:04.651 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:04.651 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:04.651 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:46:04.651 INFO:teuthology.orchestra.run.trial053.stdout: ceph-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:46:04.651 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:04.651 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:04.678 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-volume 2026-02-24T15:46:04.998 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:23 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:05.082 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repository Size 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout: ceph-volume noarch 2:20.3.0-5343.gd26e5c22.el9 ceph-noarch 301 k 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:Install 2 Packages 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 652 k 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 2.2 M 2026-02-24T15:46:05.083 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:46:05.200 INFO:teuthology.orchestra.run.trial053.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 11 MB/s | 351 kB 00:00 2026-02-24T15:46:06.493 INFO:teuthology.orchestra.run.trial053.stdout:(2/2): ceph-volume-20.3.0-5343.gd26e5c22.el9.no 227 kB/s | 301 kB 00:01 2026-02-24T15:46:06.494 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:46:06.494 INFO:teuthology.orchestra.run.trial053.stdout:Total 462 kB/s | 652 kB 00:01 2026-02-24T15:46:06.502 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:46:06.508 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:46:06.508 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:46:06.551 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:46:06.551 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:46:06.632 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:46:06.694 INFO:teuthology.orchestra.run.trial053.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T15:46:06.696 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-volume-2:20.3.0-5343.gd26e5c22.el9.noarch 2/2 2026-02-24T15:46:06.711 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-volume-2:20.3.0-5343.gd26e5c22.el9.noarch 2/2 2026-02-24T15:46:06.711 INFO:teuthology.orchestra.run.trial053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T15:46:06.711 INFO:teuthology.orchestra.run.trial053.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T15:46:06.711 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:06.940 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-volume-2:20.3.0-5343.gd26e5c22.el9.noarch 1/2 2026-02-24T15:46:07.002 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T15:46:07.002 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:07.002 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:46:07.002 INFO:teuthology.orchestra.run.trial053.stdout: ceph-volume-2:20.3.0-5343.gd26e5c22.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T15:46:07.002 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:07.002 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:07.030 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install librados-devel 2026-02-24T15:46:07.356 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:26 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:07.439 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:07.439 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:07.439 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repo Size 2026-02-24T15:46:07.439 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:07.439 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:46:07.440 INFO:teuthology.orchestra.run.trial053.stdout: librados-devel x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 124 k 2026-02-24T15:46:07.440 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:07.440 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:46:07.440 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:07.440 INFO:teuthology.orchestra.run.trial053.stdout:Install 1 Package 2026-02-24T15:46:07.440 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:07.440 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 124 k 2026-02-24T15:46:07.440 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 434 k 2026-02-24T15:46:07.440 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:46:07.984 INFO:teuthology.orchestra.run.trial053.stdout:librados-devel-20.3.0-5343.gd26e5c22.el9.x86_64 228 kB/s | 124 kB 00:00 2026-02-24T15:46:07.984 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:46:07.984 INFO:teuthology.orchestra.run.trial053.stdout:Total 227 kB/s | 124 kB 00:00 2026-02-24T15:46:07.984 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:46:07.987 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:46:07.987 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:46:08.018 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:46:08.018 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:46:08.072 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:46:08.089 INFO:teuthology.orchestra.run.trial053.stdout: Installing : librados-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:08.176 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: librados-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:08.238 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : librados-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:08.238 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:08.238 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:46:08.238 INFO:teuthology.orchestra.run.trial053.stdout: librados-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:46:08.238 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:08.238 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:08.265 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install libcephfs2 2026-02-24T15:46:08.586 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:27 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:08.651 INFO:teuthology.orchestra.run.trial053.stdout:Package libcephfs2-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:46:08.670 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:08.670 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:46:08.670 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:08.691 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install libcephfs-devel 2026-02-24T15:46:08.999 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:27 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:09.083 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repo Size 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout: libcephfs-devel x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 37 k 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:Installing dependencies: 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 26 k 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:Install 2 Packages 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 63 k 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 227 k 2026-02-24T15:46:09.084 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:46:09.435 INFO:teuthology.orchestra.run.trial053.stdout:(1/2): libcephfs-proxy2-20.3.0-5343.gd26e5c22.e 73 kB/s | 26 kB 00:00 2026-02-24T15:46:09.438 INFO:teuthology.orchestra.run.trial053.stdout:(2/2): libcephfs-devel-20.3.0-5343.gd26e5c22.el 105 kB/s | 37 kB 00:00 2026-02-24T15:46:09.439 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:46:09.439 INFO:teuthology.orchestra.run.trial053.stdout:Total 177 kB/s | 63 kB 00:00 2026-02-24T15:46:09.439 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:46:09.442 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:46:09.443 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:46:09.474 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:46:09.474 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:46:09.524 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:46:09.525 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libcephfs-proxy2-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/2 2026-02-24T15:46:09.540 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/2 2026-02-24T15:46:09.557 INFO:teuthology.orchestra.run.trial053.stdout: Installing : libcephfs-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 2/2 2026-02-24T15:46:09.616 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 2/2 2026-02-24T15:46:09.616 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libcephfs-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/2 2026-02-24T15:46:09.677 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5343.gd26e5c22.el9.x86_64 2/2 2026-02-24T15:46:09.677 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:09.677 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:46:09.678 INFO:teuthology.orchestra.run.trial053.stdout: libcephfs-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:46:09.678 INFO:teuthology.orchestra.run.trial053.stdout: libcephfs-proxy2-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:46:09.678 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:09.678 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:09.704 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install librados2 2026-02-24T15:46:10.018 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:29 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:10.084 INFO:teuthology.orchestra.run.trial053.stdout:Package librados2-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:46:10.103 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:10.103 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:46:10.103 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:10.125 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install librbd1 2026-02-24T15:46:10.446 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:29 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:10.511 INFO:teuthology.orchestra.run.trial053.stdout:Package librbd1-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:46:10.530 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:10.530 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:46:10.530 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:10.551 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install python3-rados 2026-02-24T15:46:10.868 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:29 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:10.933 INFO:teuthology.orchestra.run.trial053.stdout:Package python3-rados-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:46:10.952 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:10.952 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:46:10.952 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:10.973 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install python3-rgw 2026-02-24T15:46:11.290 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:30 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:11.355 INFO:teuthology.orchestra.run.trial053.stdout:Package python3-rgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:46:11.374 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:11.374 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:46:11.375 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:11.396 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install python3-cephfs 2026-02-24T15:46:11.712 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:30 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:11.777 INFO:teuthology.orchestra.run.trial053.stdout:Package python3-cephfs-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:46:11.795 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:11.796 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:46:11.796 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:11.817 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install python3-rbd 2026-02-24T15:46:12.132 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:31 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:12.197 INFO:teuthology.orchestra.run.trial053.stdout:Package python3-rbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:46:12.215 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:12.216 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:46:12.216 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:12.237 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install rbd-fuse 2026-02-24T15:46:12.552 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:31 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:12.637 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:12.637 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:12.637 INFO:teuthology.orchestra.run.trial053.stdout: Package Architecture Version Repository Size 2026-02-24T15:46:12.637 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:12.637 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:46:12.637 INFO:teuthology.orchestra.run.trial053.stdout: rbd-fuse x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 86 k 2026-02-24T15:46:12.638 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:12.638 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:46:12.638 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:12.638 INFO:teuthology.orchestra.run.trial053.stdout:Install 1 Package 2026-02-24T15:46:12.638 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:12.638 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 86 k 2026-02-24T15:46:12.638 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 236 k 2026-02-24T15:46:12.638 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:46:13.269 INFO:teuthology.orchestra.run.trial053.stdout:rbd-fuse-20.3.0-5343.gd26e5c22.el9.x86_64.rpm 137 kB/s | 86 kB 00:00 2026-02-24T15:46:13.269 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:46:13.269 INFO:teuthology.orchestra.run.trial053.stdout:Total 137 kB/s | 86 kB 00:00 2026-02-24T15:46:13.269 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:46:13.273 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:46:13.273 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:46:13.303 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:46:13.303 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:46:13.355 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:46:13.372 INFO:teuthology.orchestra.run.trial053.stdout: Installing : rbd-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:13.463 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:13.527 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : rbd-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:13.527 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:13.527 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:46:13.527 INFO:teuthology.orchestra.run.trial053.stdout: rbd-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:46:13.527 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:13.527 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:13.555 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install rbd-mirror 2026-02-24T15:46:13.876 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:32 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repo Size 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout: rbd-mirror x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 2.6 M 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:Install 1 Package 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 2.6 M 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 11 M 2026-02-24T15:46:13.962 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:46:19.241 INFO:teuthology.orchestra.run.trial053.stdout:rbd-mirror-20.3.0-5343.gd26e5c22.el9.x86_64.rpm 503 kB/s | 2.6 MB 00:05 2026-02-24T15:46:19.241 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:46:19.241 INFO:teuthology.orchestra.run.trial053.stdout:Total 503 kB/s | 2.6 MB 00:05 2026-02-24T15:46:19.241 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:46:19.247 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:46:19.247 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:46:19.284 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:46:19.285 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:46:19.446 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:46:19.448 INFO:teuthology.orchestra.run.trial053.stdout: Installing : rbd-mirror-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:19.472 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:19.472 INFO:teuthology.orchestra.run.trial053.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T15:46:19.472 INFO:teuthology.orchestra.run.trial053.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T15:46:19.472 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T15:46:19.472 INFO:teuthology.orchestra.run.trial053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T15:46:19.472 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:19.774 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : rbd-mirror-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:19.774 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:19.774 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:46:19.774 INFO:teuthology.orchestra.run.trial053.stdout: rbd-mirror-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:46:19.775 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:19.775 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:19.802 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install rbd-nbd 2026-02-24T15:46:20.128 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:39 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:20.214 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:20.214 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:20.214 INFO:teuthology.orchestra.run.trial053.stdout: Package Architecture Version Repository Size 2026-02-24T15:46:20.214 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:20.214 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:46:20.214 INFO:teuthology.orchestra.run.trial053.stdout: rbd-nbd x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 167 k 2026-02-24T15:46:20.214 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:20.215 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:46:20.215 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:20.215 INFO:teuthology.orchestra.run.trial053.stdout:Install 1 Package 2026-02-24T15:46:20.215 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:20.215 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 167 k 2026-02-24T15:46:20.215 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 496 k 2026-02-24T15:46:20.215 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T15:46:20.709 INFO:teuthology.orchestra.run.trial053.stdout:rbd-nbd-20.3.0-5343.gd26e5c22.el9.x86_64.rpm 337 kB/s | 167 kB 00:00 2026-02-24T15:46:20.710 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T15:46:20.710 INFO:teuthology.orchestra.run.trial053.stdout:Total 336 kB/s | 167 kB 00:00 2026-02-24T15:46:20.710 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T15:46:20.715 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T15:46:20.715 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T15:46:20.746 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T15:46:20.746 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T15:46:20.801 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T15:46:20.819 INFO:teuthology.orchestra.run.trial053.stdout: Installing : rbd-nbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:20.912 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:20.974 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : rbd-nbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 1/1 2026-02-24T15:46:20.974 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:20.974 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T15:46:20.974 INFO:teuthology.orchestra.run.trial053.stdout: rbd-nbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T15:46:20.974 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:20.974 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:21.003 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-osd-crimson 2026-02-24T15:46:21.322 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:40 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:21.387 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-osd-crimson-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T15:46:21.406 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:21.406 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T15:46:21.407 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T15:46:21.427 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-24T15:46:21.738 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:06:40 ago on Tue 24 Feb 2026 03:39:41 PM UTC. 2026-02-24T15:46:21.823 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T15:46:21.823 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:21.823 INFO:teuthology.orchestra.run.trial053.stdout: Package Arch Version Repo Size 2026-02-24T15:46:21.823 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:21.823 INFO:teuthology.orchestra.run.trial053.stdout:Installing: 2026-02-24T15:46:21.823 INFO:teuthology.orchestra.run.trial053.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5343.gd26e5c22.el9 ceph 433 M 2026-02-24T15:46:21.823 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:21.823 INFO:teuthology.orchestra.run.trial053.stdout:Transaction Summary 2026-02-24T15:46:21.824 INFO:teuthology.orchestra.run.trial053.stdout:================================================================================ 2026-02-24T15:46:21.824 INFO:teuthology.orchestra.run.trial053.stdout:Install 1 Package 2026-02-24T15:46:21.824 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T15:46:21.824 INFO:teuthology.orchestra.run.trial053.stdout:Total download size: 433 M 2026-02-24T15:46:21.824 INFO:teuthology.orchestra.run.trial053.stdout:Installed size: 2.6 G 2026-02-24T15:46:21.824 INFO:teuthology.orchestra.run.trial053.stdout:Downloading Packages: 2026-02-24T16:07:16.705 INFO:teuthology.orchestra.run.trial053.stdout:ceph-osd-crimson-debuginfo-20.3.0-5343.gd26e5c2 354 kB/s | 433 MB 20:54 2026-02-24T16:07:16.705 INFO:teuthology.orchestra.run.trial053.stdout:-------------------------------------------------------------------------------- 2026-02-24T16:07:16.706 INFO:teuthology.orchestra.run.trial053.stdout:Total 354 kB/s | 433 MB 20:54 2026-02-24T16:07:16.706 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction check 2026-02-24T16:07:16.708 INFO:teuthology.orchestra.run.trial053.stdout:Transaction check succeeded. 2026-02-24T16:07:16.708 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction test 2026-02-24T16:07:18.002 INFO:teuthology.orchestra.run.trial053.stdout:Transaction test succeeded. 2026-02-24T16:07:18.002 INFO:teuthology.orchestra.run.trial053.stdout:Running transaction 2026-02-24T16:07:41.695 INFO:teuthology.orchestra.run.trial053.stdout: Preparing : 1/1 2026-02-24T16:07:41.712 INFO:teuthology.orchestra.run.trial053.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5343.gd26e5c22.e 1/1 2026-02-24T16:07:43.670 INFO:teuthology.orchestra.run.trial053.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5343.gd26e5c22.e 1/1 2026-02-24T16:07:43.730 INFO:teuthology.orchestra.run.trial053.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5343.gd26e5c22.e 1/1 2026-02-24T16:07:43.730 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:07:43.730 INFO:teuthology.orchestra.run.trial053.stdout:Installed: 2026-02-24T16:07:43.730 INFO:teuthology.orchestra.run.trial053.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5343.gd26e5c22.el9.x86_64 2026-02-24T16:07:43.731 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:07:43.731 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:07:43.803 DEBUG:teuthology.parallel:result is None 2026-02-24T16:07:43.804 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=d26e5c228e3cdea4d585bcd077f8513a649ab5d1 2026-02-24T16:07:43.973 DEBUG:teuthology.orchestra.run.trial053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T16:07:43.995 INFO:teuthology.orchestra.run.trial053.stdout:20.3.0-5343.gd26e5c22.el9 2026-02-24T16:07:43.995 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5343.gd26e5c22.el9 2026-02-24T16:07:43.995 INFO:teuthology.task.install:The correct ceph version 20.3.0-5343.gd26e5c22 is installed. 2026-02-24T16:07:43.997 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T16:07:43.997 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:07:43.998 DEBUG:teuthology.orchestra.run.trial053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T16:07:44.060 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T16:07:44.061 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:07:44.061 DEBUG:teuthology.orchestra.run.trial053:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T16:07:44.125 DEBUG:teuthology.orchestra.run.trial053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T16:07:44.188 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T16:07:44.189 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:07:44.189 DEBUG:teuthology.orchestra.run.trial053:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T16:07:44.251 DEBUG:teuthology.orchestra.run.trial053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T16:07:44.314 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T16:07:44.314 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:07:44.314 DEBUG:teuthology.orchestra.run.trial053:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T16:07:44.378 DEBUG:teuthology.orchestra.run.trial053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T16:07:44.442 INFO:teuthology.run_tasks:Running task pexec... 2026-02-24T16:07:44.461 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-24T16:07:44.461 DEBUG:teuthology.orchestra.run.trial053:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-24T16:07:44.484 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:07:44.485 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-24T16:07:44.535 DEBUG:teuthology.parallel:result is None 2026-02-24T16:07:44.535 INFO:teuthology.run_tasks:Running task install... 2026-02-24T16:07:44.549 DEBUG:teuthology.task.install:project ceph 2026-02-24T16:07:44.549 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}} 2026-02-24T16:07:44.549 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'} 2026-02-24T16:07:44.550 INFO:teuthology.task.install:Using flavor: debug 2026-02-24T16:07:44.558 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-24T16:07:44.558 INFO:teuthology.task.install:extra packages: [] 2026-02-24T16:07:44.559 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1', 'tag': None, 'wait_for_package': False} 2026-02-24T16:07:44.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=d26e5c228e3cdea4d585bcd077f8513a649ab5d1 2026-02-24T16:07:44.714 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-liucm-shard-redesign-crimson-only/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/centos/9/flavors/debug/ 2026-02-24T16:07:44.714 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5343.gd26e5c22 2026-02-24T16:07:45.096 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-liucm-shard-redesign-crimson-only/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-liucm-shard-redesign-crimson-only/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-liucm-shard-redesign-crimson-only/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T16:07:45.097 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:07:45.097 DEBUG:teuthology.orchestra.run.trial053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T16:07:45.122 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-24T16:07:45.122 DEBUG:teuthology.orchestra.run.trial053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d26e5c228e3cdea4d585bcd077f8513a649ab5d1/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T16:07:45.186 DEBUG:teuthology.orchestra.run.trial053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T16:07:45.250 DEBUG:teuthology.orchestra.run.trial053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T16:07:45.306 INFO:teuthology.orchestra.run.trial053.stdout:check_obsoletes = 1 2026-02-24T16:07:45.316 DEBUG:teuthology.orchestra.run.trial053:> sudo yum clean all 2026-02-24T16:07:45.477 INFO:teuthology.orchestra.run.trial053.stdout:56 files removed 2026-02-24T16:07:45.493 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-radosgw 2026-02-24T16:07:46.405 INFO:teuthology.orchestra.run.trial053.stdout:ceph packages for x86_64 121 kB/s | 92 kB 00:00 2026-02-24T16:07:47.070 INFO:teuthology.orchestra.run.trial053.stdout:ceph noarch packages 37 kB/s | 24 kB 00:00 2026-02-24T16:07:47.672 INFO:teuthology.orchestra.run.trial053.stdout:ceph source packages 3.6 kB/s | 2.1 kB 00:00 2026-02-24T16:07:48.773 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.9 MB 00:01 2026-02-24T16:07:51.815 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-24T16:08:01.261 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 8.0 MB 00:07 2026-02-24T16:08:02.890 INFO:teuthology.orchestra.run.trial053.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-24T16:08:03.498 INFO:teuthology.orchestra.run.trial053.stdout:Extra Packages for Enterprise Linux 37 MB/s | 20 MB 00:00 2026-02-24T16:08:06.672 INFO:teuthology.orchestra.run.trial053.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T16:08:07.852 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-radosgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:07.871 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:07.872 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:07.872 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:07.895 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-test 2026-02-24T16:08:08.216 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:02 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:08.281 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-test-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:08.300 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:08.300 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:08.301 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:08.322 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph 2026-02-24T16:08:08.636 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:02 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:08.701 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:08.720 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:08.721 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:08.721 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:08.742 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-base 2026-02-24T16:08:09.066 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:03 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:09.133 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-base-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:09.151 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:09.152 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:09.152 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:09.174 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install cephadm 2026-02-24T16:08:09.493 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:03 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:09.559 INFO:teuthology.orchestra.run.trial053.stdout:Package cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch is already installed. 2026-02-24T16:08:09.577 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:09.578 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:09.578 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:09.599 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T16:08:09.911 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:03 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:09.976 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-immutable-object-cache-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:09.994 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:09.995 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:09.995 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:10.017 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr 2026-02-24T16:08:10.335 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:04 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:10.402 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-mgr-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:10.421 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:10.421 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:10.422 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:10.443 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T16:08:10.753 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:04 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:10.820 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-mgr-dashboard-2:20.3.0-5343.gd26e5c22.el9.noarch is already installed. 2026-02-24T16:08:10.839 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:10.839 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:10.840 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:10.861 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T16:08:11.178 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:05 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:11.243 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5343.gd26e5c22.el9.noarch is already installed. 2026-02-24T16:08:11.262 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:11.263 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:11.263 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:11.285 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr-rook 2026-02-24T16:08:11.603 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:05 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:11.668 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-mgr-rook-2:20.3.0-5343.gd26e5c22.el9.noarch is already installed. 2026-02-24T16:08:11.686 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:11.687 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:11.687 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:11.709 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T16:08:12.028 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:06 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:12.095 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-mgr-cephadm-2:20.3.0-5343.gd26e5c22.el9.noarch is already installed. 2026-02-24T16:08:12.113 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:12.114 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:12.114 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:12.135 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-osd 2026-02-24T16:08:12.454 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:06 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:12.519 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-osd-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:12.538 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:12.539 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:12.539 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:12.560 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-osd-classic 2026-02-24T16:08:12.878 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:06 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:12.943 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-osd-classic-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:12.962 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:12.962 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:12.963 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:12.985 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-fuse 2026-02-24T16:08:13.306 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:07 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:13.371 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:13.390 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:13.390 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:13.390 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:13.412 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install ceph-volume 2026-02-24T16:08:13.731 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:07 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:13.796 INFO:teuthology.orchestra.run.trial053.stdout:Package ceph-volume-2:20.3.0-5343.gd26e5c22.el9.noarch is already installed. 2026-02-24T16:08:13.815 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:13.816 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:13.816 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:13.838 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install librados-devel 2026-02-24T16:08:14.155 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:08 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:14.220 INFO:teuthology.orchestra.run.trial053.stdout:Package librados-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:14.239 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:14.239 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:14.239 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:14.261 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install libcephfs2 2026-02-24T16:08:14.576 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:08 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:14.642 INFO:teuthology.orchestra.run.trial053.stdout:Package libcephfs2-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:14.661 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:14.661 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:14.661 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:14.683 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install libcephfs-devel 2026-02-24T16:08:15.006 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:09 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:15.073 INFO:teuthology.orchestra.run.trial053.stdout:Package libcephfs-devel-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:15.091 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:15.092 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:15.092 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:15.113 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install librados2 2026-02-24T16:08:15.433 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:09 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:15.498 INFO:teuthology.orchestra.run.trial053.stdout:Package librados2-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:15.517 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:15.518 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:15.518 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:15.539 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install librbd1 2026-02-24T16:08:15.855 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:09 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:15.922 INFO:teuthology.orchestra.run.trial053.stdout:Package librbd1-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:15.941 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:15.941 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:15.941 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:15.964 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install python3-rados 2026-02-24T16:08:16.279 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:10 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:16.346 INFO:teuthology.orchestra.run.trial053.stdout:Package python3-rados-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:16.364 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:16.365 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:16.365 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:16.387 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install python3-rgw 2026-02-24T16:08:16.703 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:10 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:16.768 INFO:teuthology.orchestra.run.trial053.stdout:Package python3-rgw-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:16.787 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:16.787 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:16.788 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:16.810 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install python3-cephfs 2026-02-24T16:08:17.126 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:11 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:17.191 INFO:teuthology.orchestra.run.trial053.stdout:Package python3-cephfs-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:17.210 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:17.211 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:17.211 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:17.233 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install python3-rbd 2026-02-24T16:08:17.571 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:11 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:17.635 INFO:teuthology.orchestra.run.trial053.stdout:Package python3-rbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:17.654 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:17.655 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:17.655 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:17.676 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install rbd-fuse 2026-02-24T16:08:17.994 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:11 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:18.060 INFO:teuthology.orchestra.run.trial053.stdout:Package rbd-fuse-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:18.078 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:18.079 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:18.079 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:18.102 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install rbd-mirror 2026-02-24T16:08:18.418 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:12 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:18.483 INFO:teuthology.orchestra.run.trial053.stdout:Package rbd-mirror-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:18.501 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:18.502 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:18.502 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:18.523 DEBUG:teuthology.orchestra.run.trial053:> sudo yum -y install rbd-nbd 2026-02-24T16:08:18.846 INFO:teuthology.orchestra.run.trial053.stdout:Last metadata expiration check: 0:00:12 ago on Tue 24 Feb 2026 04:08:06 PM UTC. 2026-02-24T16:08:18.911 INFO:teuthology.orchestra.run.trial053.stdout:Package rbd-nbd-2:20.3.0-5343.gd26e5c22.el9.x86_64 is already installed. 2026-02-24T16:08:18.929 INFO:teuthology.orchestra.run.trial053.stdout:Dependencies resolved. 2026-02-24T16:08:18.930 INFO:teuthology.orchestra.run.trial053.stdout:Nothing to do. 2026-02-24T16:08:18.930 INFO:teuthology.orchestra.run.trial053.stdout:Complete! 2026-02-24T16:08:18.955 DEBUG:teuthology.parallel:result is None 2026-02-24T16:08:18.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=d26e5c228e3cdea4d585bcd077f8513a649ab5d1 2026-02-24T16:08:19.129 DEBUG:teuthology.orchestra.run.trial053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T16:08:19.151 INFO:teuthology.orchestra.run.trial053.stdout:20.3.0-5343.gd26e5c22.el9 2026-02-24T16:08:19.151 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5343.gd26e5c22.el9 2026-02-24T16:08:19.151 INFO:teuthology.task.install:The correct ceph version 20.3.0-5343.gd26e5c22 is installed. 2026-02-24T16:08:19.154 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-24T16:08:19.154 INFO:teuthology.run_tasks:Running task ceph... 2026-02-24T16:08:19.263 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-24T16:08:19.265 DEBUG:teuthology.orchestra.run.trial053:> sudo chmod 777 /var/log/ceph 2026-02-24T16:08:19.290 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-24T16:08:19.290 DEBUG:teuthology.orchestra.run.trial053:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T16:08:19.355 INFO:tasks.ceph:Creating extra log directories... 2026-02-24T16:08:19.355 DEBUG:teuthology.orchestra.run.trial053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T16:08:19.430 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-24T16:08:19.430 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-24T16:08:19.430 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial/68165', 'branch': 'wip-liucm-shard-redesign-crimson-only', 'description': 'crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '68165', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-liucm-shard-redesign-crimson-only'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}}, 'workunit': {'branch': 'wip-liucm-shard-redesign-crimson-only', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}}, 'owner': 'scheduled_liucm@soko04.front.sepia.ceph.com', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']], 'seed': 9834, 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'wip-liucm-shard-redesign-crimson-only', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d26e5c228e3cdea4d585bcd077f8513a649ab5d1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1', 'targets': {'trial053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBf74I6lQX8UzajKEwZt3MwgC0b+OI5Y40XI9q+Tj/tT3n/qk7h2ip7SWoewfX1ULe7dCNVmpui4N3ZQlGna1xk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1', 'cluster': 'ceph'}}, {'ceph_objectstore_tool': {'crimson_objectstore_tool': True, 'objects': 5, 'pgnum': 8}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-24_15:28:57', 'tube': 'trial', 'user': 'liucm', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-24T16:08:19.431 DEBUG:teuthology.orchestra.run.trial053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T16:08:19.476 DEBUG:teuthology.orchestra.run.trial053:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T16:08:19.540 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:19.540 DEBUG:teuthology.orchestra.run.trial053:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T16:08:19.596 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T16:08:19.597 DEBUG:teuthology.orchestra.run.trial053:> stat /dev/vg_nvme/lv_1 2026-02-24T16:08:19.652 INFO:teuthology.orchestra.run.trial053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T16:08:19.653 INFO:teuthology.orchestra.run.trial053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T16:08:19.653 INFO:teuthology.orchestra.run.trial053.stdout:Device: 6h/6d Inode: 917 Links: 1 2026-02-24T16:08:19.653 INFO:teuthology.orchestra.run.trial053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T16:08:19.653 INFO:teuthology.orchestra.run.trial053.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T16:08:19.653 INFO:teuthology.orchestra.run.trial053.stdout:Access: 2026-02-24 15:46:19.610359025 +0000 2026-02-24T16:08:19.653 INFO:teuthology.orchestra.run.trial053.stdout:Modify: 2026-02-24 15:39:10.869044636 +0000 2026-02-24T16:08:19.653 INFO:teuthology.orchestra.run.trial053.stdout:Change: 2026-02-24 15:39:10.869044636 +0000 2026-02-24T16:08:19.653 INFO:teuthology.orchestra.run.trial053.stdout: Birth: 2026-02-24 15:39:10.869044636 +0000 2026-02-24T16:08:19.654 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T16:08:19.716 INFO:teuthology.orchestra.run.trial053.stderr:1+0 records in 2026-02-24T16:08:19.717 INFO:teuthology.orchestra.run.trial053.stderr:1+0 records out 2026-02-24T16:08:19.717 INFO:teuthology.orchestra.run.trial053.stderr:512 bytes copied, 0.000152594 s, 3.4 MB/s 2026-02-24T16:08:19.718 DEBUG:teuthology.orchestra.run.trial053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T16:08:19.775 DEBUG:teuthology.orchestra.run.trial053:> stat /dev/vg_nvme/lv_2 2026-02-24T16:08:19.831 INFO:teuthology.orchestra.run.trial053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T16:08:19.832 INFO:teuthology.orchestra.run.trial053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T16:08:19.832 INFO:teuthology.orchestra.run.trial053.stdout:Device: 6h/6d Inode: 945 Links: 1 2026-02-24T16:08:19.832 INFO:teuthology.orchestra.run.trial053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T16:08:19.832 INFO:teuthology.orchestra.run.trial053.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T16:08:19.832 INFO:teuthology.orchestra.run.trial053.stdout:Access: 2026-02-24 15:46:19.611358986 +0000 2026-02-24T16:08:19.832 INFO:teuthology.orchestra.run.trial053.stdout:Modify: 2026-02-24 15:39:11.100035863 +0000 2026-02-24T16:08:19.832 INFO:teuthology.orchestra.run.trial053.stdout:Change: 2026-02-24 15:39:11.100035863 +0000 2026-02-24T16:08:19.832 INFO:teuthology.orchestra.run.trial053.stdout: Birth: 2026-02-24 15:39:11.100035863 +0000 2026-02-24T16:08:19.833 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T16:08:19.894 INFO:teuthology.orchestra.run.trial053.stderr:1+0 records in 2026-02-24T16:08:19.895 INFO:teuthology.orchestra.run.trial053.stderr:1+0 records out 2026-02-24T16:08:19.895 INFO:teuthology.orchestra.run.trial053.stderr:512 bytes copied, 0.00014005 s, 3.7 MB/s 2026-02-24T16:08:19.896 DEBUG:teuthology.orchestra.run.trial053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T16:08:19.953 DEBUG:teuthology.orchestra.run.trial053:> stat /dev/vg_nvme/lv_3 2026-02-24T16:08:20.009 INFO:teuthology.orchestra.run.trial053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T16:08:20.010 INFO:teuthology.orchestra.run.trial053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T16:08:20.010 INFO:teuthology.orchestra.run.trial053.stdout:Device: 6h/6d Inode: 972 Links: 1 2026-02-24T16:08:20.010 INFO:teuthology.orchestra.run.trial053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T16:08:20.010 INFO:teuthology.orchestra.run.trial053.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T16:08:20.010 INFO:teuthology.orchestra.run.trial053.stdout:Access: 2026-02-24 15:46:19.611358986 +0000 2026-02-24T16:08:20.010 INFO:teuthology.orchestra.run.trial053.stdout:Modify: 2026-02-24 15:39:11.311027849 +0000 2026-02-24T16:08:20.010 INFO:teuthology.orchestra.run.trial053.stdout:Change: 2026-02-24 15:39:11.311027849 +0000 2026-02-24T16:08:20.010 INFO:teuthology.orchestra.run.trial053.stdout: Birth: 2026-02-24 15:39:11.311027849 +0000 2026-02-24T16:08:20.011 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T16:08:20.073 INFO:teuthology.orchestra.run.trial053.stderr:1+0 records in 2026-02-24T16:08:20.074 INFO:teuthology.orchestra.run.trial053.stderr:1+0 records out 2026-02-24T16:08:20.074 INFO:teuthology.orchestra.run.trial053.stderr:512 bytes copied, 0.000159918 s, 3.2 MB/s 2026-02-24T16:08:20.075 DEBUG:teuthology.orchestra.run.trial053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T16:08:20.132 DEBUG:teuthology.orchestra.run.trial053:> stat /dev/vg_nvme/lv_4 2026-02-24T16:08:20.188 INFO:teuthology.orchestra.run.trial053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T16:08:20.188 INFO:teuthology.orchestra.run.trial053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T16:08:20.188 INFO:teuthology.orchestra.run.trial053.stdout:Device: 6h/6d Inode: 1001 Links: 1 2026-02-24T16:08:20.189 INFO:teuthology.orchestra.run.trial053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T16:08:20.189 INFO:teuthology.orchestra.run.trial053.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T16:08:20.189 INFO:teuthology.orchestra.run.trial053.stdout:Access: 2026-02-24 15:46:19.611358986 +0000 2026-02-24T16:08:20.189 INFO:teuthology.orchestra.run.trial053.stdout:Modify: 2026-02-24 15:39:11.532019456 +0000 2026-02-24T16:08:20.189 INFO:teuthology.orchestra.run.trial053.stdout:Change: 2026-02-24 15:39:11.532019456 +0000 2026-02-24T16:08:20.189 INFO:teuthology.orchestra.run.trial053.stdout: Birth: 2026-02-24 15:39:11.532019456 +0000 2026-02-24T16:08:20.189 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T16:08:20.250 INFO:teuthology.orchestra.run.trial053.stderr:1+0 records in 2026-02-24T16:08:20.250 INFO:teuthology.orchestra.run.trial053.stderr:1+0 records out 2026-02-24T16:08:20.251 INFO:teuthology.orchestra.run.trial053.stderr:512 bytes copied, 0.000144518 s, 3.5 MB/s 2026-02-24T16:08:20.252 DEBUG:teuthology.orchestra.run.trial053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T16:08:20.309 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-24T16:08:20.309 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-24T16:08:20.309 INFO:tasks.ceph:Generating config... 2026-02-24T16:08:20.312 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-24T16:08:20.312 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-24T16:08:20.312 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-24T16:08:20.312 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-24T16:08:20.313 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-24T16:08:20.313 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-24T16:08:20.313 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-24T16:08:20.313 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-24T16:08:20.313 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-24T16:08:20.313 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-24T16:08:20.313 INFO:tasks.ceph:[osd] crimson cpu num = 3 2026-02-24T16:08:20.313 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-24T16:08:20.313 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-24T16:08:20.313 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-24T16:08:20.313 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-24T16:08:20.314 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-24T16:08:20.315 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-24T16:08:20.315 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-24T16:08:20.315 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-24T16:08:20.315 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-24T16:08:20.315 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-24T16:08:20.315 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-24T16:08:20.315 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-24T16:08:20.315 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-24T16:08:20.315 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-24T16:08:20.315 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-24T16:08:20.315 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-24T16:08:20.315 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-24T16:08:20.316 INFO:tasks.ceph:Setting up mon.a... 2026-02-24T16:08:20.316 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-24T16:08:20.391 INFO:teuthology.orchestra.run.trial053.stdout:creating /etc/ceph/ceph.keyring 2026-02-24T16:08:20.394 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-24T16:08:20.478 DEBUG:teuthology.orchestra.run.trial053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T16:08:20.543 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.53')] 2026-02-24T16:08:20.544 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.53', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-24T16:08:20.545 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:20.545 DEBUG:teuthology.orchestra.run.trial053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T16:08:20.599 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.53 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-24T16:08:20.678 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:20.677+0000 7f83ba8daf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:20.679 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:20.677+0000 7f83ba8daf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:20.679 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:20.677+0000 7f83ba8daf40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:20.680 INFO:teuthology.orchestra.run.trial053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-24T16:08:20.680 INFO:teuthology.orchestra.run.trial053.stdout:monmaptool: generated fsid 6abeadec-6aab-4afb-8494-572099c2e04c 2026-02-24T16:08:20.680 INFO:teuthology.orchestra.run.trial053.stdout:setting min_mon_release = tentacle 2026-02-24T16:08:20.680 INFO:teuthology.orchestra.run.trial053.stdout:epoch 0 2026-02-24T16:08:20.680 INFO:teuthology.orchestra.run.trial053.stdout:fsid 6abeadec-6aab-4afb-8494-572099c2e04c 2026-02-24T16:08:20.680 INFO:teuthology.orchestra.run.trial053.stdout:last_changed 2026-02-24T16:08:20.677926+0000 2026-02-24T16:08:20.681 INFO:teuthology.orchestra.run.trial053.stdout:created 2026-02-24T16:08:20.677926+0000 2026-02-24T16:08:20.681 INFO:teuthology.orchestra.run.trial053.stdout:min_mon_release 20 (tentacle) 2026-02-24T16:08:20.681 INFO:teuthology.orchestra.run.trial053.stdout:election_strategy: 1 2026-02-24T16:08:20.681 INFO:teuthology.orchestra.run.trial053.stdout:0: [v2:10.20.193.53:3300/0,v1:10.20.193.53:6789/0] mon.a 2026-02-24T16:08:20.681 INFO:teuthology.orchestra.run.trial053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-24T16:08:20.682 DEBUG:teuthology.orchestra.run.trial053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T16:08:20.737 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6abeadec-6aab-4afb-8494-572099c2e04c... 2026-02-24T16:08:20.738 DEBUG:teuthology.orchestra.run.trial053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T16:08:20.817 INFO:teuthology.orchestra.run.trial053.stdout:[global] 2026-02-24T16:08:20.817 INFO:teuthology.orchestra.run.trial053.stdout: chdir = "" 2026-02-24T16:08:20.817 INFO:teuthology.orchestra.run.trial053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: auth supported = cephx 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: filestore xattr use omap = true 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: mon clock drift allowed = 1.000 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: osd crush chooseleaf type = 0 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: auth debug = true 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.818 INFO:teuthology.orchestra.run.trial053.stdout: ms die on old message = true 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: ms die on bug = true 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: mon pg warn max object skew = 0 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: osd pool default size = 2 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: mon osd allow primary affinity = true 2026-02-24T16:08:20.819 INFO:teuthology.orchestra.run.trial053.stdout: mon osd allow pg remap = true 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: mon warn on legacy crush tunables = false 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: mon warn on crush straw calc version zero = false 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: mon warn on no sortbitwise = false 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: mon warn on osd down out interval zero = false 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: mon warn on too few osds = false 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: mon_allow_pool_size_one = true 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.820 INFO:teuthology.orchestra.run.trial053.stdout: osd default data pool replay window = 5 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: mon allow pool delete = true 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: mon cluster log file level = debug 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: debug asserts on shutdown = true 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: mon health detail to clog = false 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: mon host = 10.20.193.53 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: ms client mode = crc 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: ms cluster mode = crc 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: ms mon client mode = crc 2026-02-24T16:08:20.821 INFO:teuthology.orchestra.run.trial053.stdout: ms mon cluster mode = crc 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: ms mon service mode = crc 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: ms service mode = crc 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: fsid = 6abeadec-6aab-4afb-8494-572099c2e04c 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout:[osd] 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: osd journal size = 100 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: osd scrub load threshold = 5.0 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: osd scrub max interval = 600 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: osd mclock profile = high_recovery_ops 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: osd mclock skip benchmark = true 2026-02-24T16:08:20.822 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: osd recover clone overlap = true 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: osd recovery max chunk = 1048576 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: osd debug shutdown = true 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: osd debug op order = true 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: osd debug verify stray on activate = true 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: osd debug trim objects = true 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: osd open classes on start = true 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: osd debug pg log writeout = true 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.823 INFO:teuthology.orchestra.run.trial053.stdout: osd deep scrub update digest min age = 30 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: osd map max advance = 10 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: journal zero on create = true 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: filestore ondisk finisher threads = 3 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: filestore apply finisher threads = 3 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: bdev debug aio = true 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: osd debug misdirected ops = true 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: debug monc = 20 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: crimson cpu num = 3 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: crimson osd obc lru size = 10 2026-02-24T16:08:20.824 INFO:teuthology.orchestra.run.trial053.stdout: debug ms = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug osd = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore backref = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore cache = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore cleaner = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore device = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore epm = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore fixedkv tree = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore journal = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore lba = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore odata = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore omap = 20 2026-02-24T16:08:20.825 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore onode = 20 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore t = 20 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: debug seastore tm = 20 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: osd objectstore = seastore 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: seastore cachepin size pershard = 64M 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: seastore max concurrent transactions = 8 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout:[mgr] 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: debug ms = 1 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: debug mgr = 20 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: debug mon = 20 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: debug auth = 20 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: mon reweight min pgs per osd = 4 2026-02-24T16:08:20.826 INFO:teuthology.orchestra.run.trial053.stdout: mon reweight min bytes per osd = 10 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: mgr/telemetry/nag = false 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout:[mon] 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: debug ms = 1 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: debug mon = 20 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: debug paxos = 20 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: debug auth = 20 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: mon data avail warn = 5 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: mon mgr mkfs grace = 240 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: mon reweight min pgs per osd = 4 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: mon osd reporter subtree level = osd 2026-02-24T16:08:20.827 INFO:teuthology.orchestra.run.trial053.stdout: mon osd prime pg temp = true 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: mon reweight min bytes per osd = 10 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: # 1m isn't quite enough 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: mon_down_mkfs_grace = 2m 2026-02-24T16:08:20.828 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: mon_warn_on_filestore_osds = false 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: mon min osdmap epochs = 50 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: mon osdmap full prune interval = 2 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: mon osdmap full prune min = 15 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: mon osdmap full prune txsize = 2 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: paxos service trim min = 10 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: osd pool default crimson = True 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout:[client] 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: rgw cache enabled = true 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: rgw enable ops log = true 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: rgw enable usage log = true 2026-02-24T16:08:20.829 INFO:teuthology.orchestra.run.trial053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T16:08:20.830 INFO:teuthology.orchestra.run.trial053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T16:08:20.830 INFO:teuthology.orchestra.run.trial053.stdout:[mon.a] 2026-02-24T16:08:20.831 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-24T16:08:20.831 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-24T16:08:20.921 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-24T16:08:20.921 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:20.921 DEBUG:teuthology.orchestra.run.trial053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-24T16:08:20.937 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:20.938 DEBUG:teuthology.orchestra.run.trial053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-24T16:08:20.994 INFO:tasks.ceph:Sending monmap to node ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:08:20.994 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:20.994 DEBUG:teuthology.orchestra.run.trial053:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T16:08:20.994 DEBUG:teuthology.orchestra.run.trial053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T16:08:21.068 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:21.068 DEBUG:teuthology.orchestra.run.trial053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T16:08:21.124 INFO:tasks.ceph:Setting up mon nodes... 2026-02-24T16:08:21.125 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-24T16:08:21.125 DEBUG:teuthology.orchestra.run.trial053:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T16:08:21.214 INFO:teuthology.orchestra.run.trial053.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T16:08:21.217 INFO:tasks.ceph:Setting up mds nodes... 2026-02-24T16:08:21.217 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-24T16:08:21.217 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T16:08:21.258 INFO:teuthology.orchestra.run.trial053.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-24T16:08:21.270 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-24T16:08:21.270 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-24T16:08:21.270 DEBUG:teuthology.orchestra.run.trial053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-24T16:08:21.335 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-24T16:08:21.335 INFO:tasks.ceph:role: osd.0 2026-02-24T16:08:21.335 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:08:21.335 DEBUG:teuthology.orchestra.run.trial053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T16:08:21.401 INFO:teuthology.orchestra.run.trial053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T16:08:21.401 INFO:teuthology.orchestra.run.trial053.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T16:08:21.401 INFO:teuthology.orchestra.run.trial053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T16:08:21.401 INFO:teuthology.orchestra.run.trial053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T16:08:21.401 INFO:teuthology.orchestra.run.trial053.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T16:08:21.401 INFO:teuthology.orchestra.run.trial053.stdout: = sunit=0 swidth=0 blks 2026-02-24T16:08:21.401 INFO:teuthology.orchestra.run.trial053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T16:08:21.401 INFO:teuthology.orchestra.run.trial053.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T16:08:21.402 INFO:teuthology.orchestra.run.trial053.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T16:08:21.402 INFO:teuthology.orchestra.run.trial053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T16:08:21.971 INFO:teuthology.orchestra.run.trial053.stdout:Discarding blocks...Done. 2026-02-24T16:08:21.973 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial053.front.sepia.ceph.com -o noatime 2026-02-24T16:08:21.974 DEBUG:teuthology.orchestra.run.trial053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-24T16:08:22.042 DEBUG:teuthology.orchestra.run.trial053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-24T16:08:22.110 DEBUG:teuthology.orchestra.run.trial053:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-24T16:08:22.174 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-24T16:08:22.174 INFO:tasks.ceph:role: osd.1 2026-02-24T16:08:22.175 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:08:22.175 DEBUG:teuthology.orchestra.run.trial053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T16:08:22.238 INFO:teuthology.orchestra.run.trial053.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T16:08:22.239 INFO:teuthology.orchestra.run.trial053.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T16:08:22.239 INFO:teuthology.orchestra.run.trial053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T16:08:22.239 INFO:teuthology.orchestra.run.trial053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T16:08:22.239 INFO:teuthology.orchestra.run.trial053.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T16:08:22.239 INFO:teuthology.orchestra.run.trial053.stdout: = sunit=0 swidth=0 blks 2026-02-24T16:08:22.239 INFO:teuthology.orchestra.run.trial053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T16:08:22.239 INFO:teuthology.orchestra.run.trial053.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T16:08:22.239 INFO:teuthology.orchestra.run.trial053.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T16:08:22.240 INFO:teuthology.orchestra.run.trial053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T16:08:22.796 INFO:teuthology.orchestra.run.trial053.stdout:Discarding blocks...Done. 2026-02-24T16:08:22.797 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial053.front.sepia.ceph.com -o noatime 2026-02-24T16:08:22.797 DEBUG:teuthology.orchestra.run.trial053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-24T16:08:22.865 DEBUG:teuthology.orchestra.run.trial053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-24T16:08:22.932 DEBUG:teuthology.orchestra.run.trial053:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-24T16:08:22.996 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-24T16:08:22.997 INFO:tasks.ceph:role: osd.2 2026-02-24T16:08:22.997 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:08:22.997 DEBUG:teuthology.orchestra.run.trial053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T16:08:23.061 INFO:teuthology.orchestra.run.trial053.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T16:08:23.061 INFO:teuthology.orchestra.run.trial053.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T16:08:23.061 INFO:teuthology.orchestra.run.trial053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T16:08:23.061 INFO:teuthology.orchestra.run.trial053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T16:08:23.061 INFO:teuthology.orchestra.run.trial053.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T16:08:23.061 INFO:teuthology.orchestra.run.trial053.stdout: = sunit=0 swidth=0 blks 2026-02-24T16:08:23.062 INFO:teuthology.orchestra.run.trial053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T16:08:23.062 INFO:teuthology.orchestra.run.trial053.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T16:08:23.062 INFO:teuthology.orchestra.run.trial053.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T16:08:23.062 INFO:teuthology.orchestra.run.trial053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T16:08:23.617 INFO:teuthology.orchestra.run.trial053.stdout:Discarding blocks...Done. 2026-02-24T16:08:23.619 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial053.front.sepia.ceph.com -o noatime 2026-02-24T16:08:23.620 DEBUG:teuthology.orchestra.run.trial053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-24T16:08:23.688 DEBUG:teuthology.orchestra.run.trial053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-24T16:08:23.754 DEBUG:teuthology.orchestra.run.trial053:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-24T16:08:23.818 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-24T16:08:23.819 INFO:tasks.ceph:role: osd.3 2026-02-24T16:08:23.819 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:08:23.819 DEBUG:teuthology.orchestra.run.trial053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T16:08:23.883 INFO:teuthology.orchestra.run.trial053.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T16:08:23.883 INFO:teuthology.orchestra.run.trial053.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T16:08:23.883 INFO:teuthology.orchestra.run.trial053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T16:08:23.883 INFO:teuthology.orchestra.run.trial053.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T16:08:23.883 INFO:teuthology.orchestra.run.trial053.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T16:08:23.883 INFO:teuthology.orchestra.run.trial053.stdout: = sunit=0 swidth=0 blks 2026-02-24T16:08:23.883 INFO:teuthology.orchestra.run.trial053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T16:08:23.884 INFO:teuthology.orchestra.run.trial053.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T16:08:23.884 INFO:teuthology.orchestra.run.trial053.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T16:08:23.884 INFO:teuthology.orchestra.run.trial053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T16:08:24.439 INFO:teuthology.orchestra.run.trial053.stdout:Discarding blocks...Done. 2026-02-24T16:08:24.441 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial053.front.sepia.ceph.com -o noatime 2026-02-24T16:08:24.441 DEBUG:teuthology.orchestra.run.trial053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-24T16:08:24.518 DEBUG:teuthology.orchestra.run.trial053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-24T16:08:24.585 DEBUG:teuthology.orchestra.run.trial053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T16:08:24.736 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: parsing early config 2026-02-24T16:08:24.789 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:24,788 seastar - Reactor backend: linux-aio 2026-02-24T16:08:24.798 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:24,798 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:24.799 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:24,798 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:24.801 INFO:teuthology.orchestra.run.trial053.stderr:==39699==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:08:24.856 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:24,855 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-24T16:08:24.857 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:24,855 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-24T16:08:24.857 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:24,855 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-24T16:08:24.857 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:24,855 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 3 2026-02-24T16:08:24.857 INFO:teuthology.orchestra.run.trial053.stderr:DEBUG 2026-02-24 16:08:24,856 [shard 0:main] seastar - reactor::drain 2026-02-24T16:08:26.926 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:26.926 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:08:26.926 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:08:26.926 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:08:26.927 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:26.927 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:08:26.945 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-24T16:08:26.945 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-24T16:08:26.987 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-24T16:08:26.987 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-24T16:08:26.993 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:26,993 seastar - Reactor backend: linux-aio 2026-02-24T16:08:27.005 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:27,005 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:27.005 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:27,005 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:27.009 INFO:teuthology.orchestra.run.trial053.stderr:==39697==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:08:27.009 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:27,008 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-24T16:08:27.066 INFO:teuthology.orchestra.run.trial053.stderr:DEBUG 2026-02-24 16:08:27,066 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-24T16:08:27.163 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6586 /lib64/libasan.so.8+0x157c7 0x9fa8cca 0x9fd9d07 0xa0a9298 0xa0d6b34 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7272fae 0x7276b31 0x72f0839 0x7747f18 0x755fef8 0x7585796 0x752dc84 0x72cd4a6 0x7632ed7 0x7534252 0x72cd53c 0x76d5c2f 0x7747fa1 0x755fffa 0x75600f2 0x7560178 0x75601fd 0x758594e 0x7748022 0x756027a 0x75602ff 0x7585b55 0x76e815e 0x76e81e3 0x76e82c1 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.164 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb07b2 /lib64/libasan.so.8+0xb1437 0xba66a7 0x10d1d1e 0xf741d0 0x9fe882e 0x9fe916d 0xa0ce105 0xa0d87eb 0x7bc72d4 0x7eff0d5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7272fae 0x7276b31 0x72f0839 0x7747f18 0x755fef8 0x7585796 0x752dc84 0x72cd4a6 0x7632ed7 0x7534252 0x72cd53c 0x76d5c2f 0x7747fa1 0x755fffa 0x75600f2 0x7560178 0x75601fd 0x758594e 0x7748022 0x756027a 0x75602ff 0x7585b55 0x76e815e 0x76e81e3 0x76e82c1 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.196 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6583 /lib64/libasan.so.8+0x15197 0x116816a 0xf741c5 0x9fe956a 0x9fe9ea9 0xa0d0ec9 0xa0d1de9 0xa0d68c7 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:27.254 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x116816a 0xf741c5 0x9fe882e 0x9fe916d 0xa0ce105 0xa0d87eb 0x7bc72d4 0x7eff0d5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.255 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0xcee22b 0x10d1c72 0xf741d0 0x9fe956a 0x9fe9ea9 0xa0d0ec9 0xa0d1de9 0xa0d68c7 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.281 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:27.306 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2ce9872 0x80977d2 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.338 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2cea6df 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.363 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 90 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.461 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c2 /lib64/libasan.so.8+0x157c7 0x7b41ec6 0x7bf4a8b 0x7bf4d9c 0x7efe753 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x722be9f 0x722c8e3 0x77424df 0x755e078 0x757f093 0x752da6e 0x71c9494 0x763159f 0x7533811 0x71c952a 0x76d525e 0x77426e1 0x755e1fe 0x755e2f6 0x755e37c 0x755e401 0x757f24a 0x7742762 0x755e47e 0x755e503 0x757f451 0x76e5fc1 0x76e6046 0x76e6124 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x77b6764 0x76973b7 0x787c3c0 0x76e6d14 0x76e6e2d 0xa3a2446 0xa3a2649 0xa3a26e7 0xa3a276c 0xa3f5b6e 0xa3f5c27 0xa427569 0xa427910 0xa32dc97 0xa32dd50 0xa32dddf 0xa3f56d6 0xa3f5799 0xa3f58a6 0xa3f5a61 0x763eb45 0x7697625 0x769785c 0x7538bad 0x726516c 0x781cf48 0x781d09c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:27.504 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0xe6c810 0xa09a4ce 0xa09a6ac 0xa09a86f 0xa09aadf 0xa09abe4 0xa0cdb7b 0xa0ce31e 0xa0d87eb 0x7bc72d4 0x7efedf5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x722be9f 0x722c8e3 0x77424df 0x755e078 0x757f093 0x752da6e 0x71c9494 0x763159f 0x7533811 0x71c952a 0x76d525e 0x77426e1 0x755e1fe 0x755e2f6 0x755e37c 0x755e401 0x757f24a 0x7742762 0x755e47e 0x755e503 0x757f451 0x76e5fc1 0x76e6046 0x76e6124 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.504 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x1168073 0xf741c5 0x9fe4d11 0x9fe500e 0x9fe5281 0x9fe6fa7 0xa0c5c7a 0xa0c7620 0xa0c7c7a 0xa0c81c0 0xa0d244e 0xa0d68c7 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x722be9f 0x722c8e3 0x77424df 0x755e078 0x757f093 0x752da6e 0x71c9494 0x763159f 0x7533811 0x71c952a 0x76d525e 0x77426e1 0x755e1fe 0x755e2f6 0x755e37c 0x755e401 0x757f24a 0x7742762 0x755e47e 0x755e503 0x757f451 0x76e5fc1 0x76e6046 0x76e6124 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.555 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x80977e7 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:27.588 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2cea293 0x80977f4 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:27.612 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 90 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:29.833 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:29.834 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:08:29.834 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:08:29.834 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:08:29.835 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:29.835 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:08:29.870 DEBUG:teuthology.orchestra.run.trial053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-24T16:08:29.895 DEBUG:teuthology.orchestra.run.trial053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T16:08:30.047 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: parsing early config 2026-02-24T16:08:30.100 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:30,099 seastar - Reactor backend: linux-aio 2026-02-24T16:08:30.114 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:30,113 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:30.114 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:30,113 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:30.116 INFO:teuthology.orchestra.run.trial053.stderr:==39767==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:08:30.171 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:30,170 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-24T16:08:30.171 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:30,170 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-24T16:08:30.171 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:30,170 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-24T16:08:30.172 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:30,170 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 3 2026-02-24T16:08:30.172 INFO:teuthology.orchestra.run.trial053.stderr:DEBUG 2026-02-24 16:08:30,170 [shard 0:main] seastar - reactor::drain 2026-02-24T16:08:32.228 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:32.228 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:08:32.228 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:08:32.228 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:08:32.228 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:32.228 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:08:32.248 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-24T16:08:32.248 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-24T16:08:32.290 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-24T16:08:32.290 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-24T16:08:32.297 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:32,297 seastar - Reactor backend: linux-aio 2026-02-24T16:08:32.311 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:32,311 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:32.311 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:32,311 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:32.315 INFO:teuthology.orchestra.run.trial053.stderr:==39765==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:08:32.315 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:32,315 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-24T16:08:32.377 INFO:teuthology.orchestra.run.trial053.stderr:DEBUG 2026-02-24 16:08:32,376 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-24T16:08:32.476 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0xe6c8a4 0xa09a4ce 0xa09a6ac 0xa09a86f 0xa09aadf 0xa09abe4 0xa0cdb7b 0xa0ce31e 0xa0d8c14 0x7bc72d4 0x7efedf5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7272fae 0x7276b31 0x72f0839 0x7747f18 0x755fef8 0x7585796 0x752dc84 0x72cd4a6 0x7632ed7 0x7534252 0x72cd53c 0x76d5c2f 0x7747fa1 0x755fffa 0x75600f2 0x7560178 0x75601fd 0x758594e 0x7748022 0x756027a 0x75602ff 0x7585b55 0x76e815e 0x76e81e3 0x76e82c1 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:32.476 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x773fb0e 0x77b155f 0x77b1696 0x763e27c 0x7bc7238 0x7eff0d5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7272fae 0x7276b31 0x72f0839 0x7747f18 0x755fef8 0x7585796 0x752dc84 0x72cd4a6 0x7632ed7 0x7534252 0x72cd53c 0x76d5c2f 0x7747fa1 0x755fffa 0x75600f2 0x7560178 0x75601fd 0x758594e 0x7748022 0x756027a 0x75602ff 0x7585b55 0x76e815e 0x76e81e3 0x76e82c1 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:32.508 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb0502 /lib64/libasan.so.8+0xb1437 0xba66a7 0x10d1d1e 0xf741d0 0x9fe4b44 0x9fe500e 0x9fe5281 0x9fe5537 0x9fe5af8 0x9fec307 0x9fec9e7 0xa0d221c 0xa0d68c7 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:32.568 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x11916f /lib64/libasan.so.8+0xebbf /lib64/libasan.so.8+0xef905 0x776e79a 0x757a2d1 0x74261e0 0x7eff354 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:32.569 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 66 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15e37 0xa0ce427 0xa0d87eb 0x7bc72d4 0x7eff0d5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:32.594 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65d9 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:32.652 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x80977a0 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:32.652 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2ce9872 0x80977d2 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:32.812 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119155 /lib64/libasan.so.8+0xc5f4 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9ec9adb 0xa09aab6 0xa09abe4 0xa0cdb7b 0xa0ce31e 0xa0d87eb 0x7bc72d4 0x7efedf5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x722be9f 0x722c8e3 0x77424df 0x755e078 0x757f093 0x752da6e 0x71c9494 0x763159f 0x7533811 0x71c952a 0x76d525e 0x77426e1 0x755e1fe 0x755e2f6 0x755e37c 0x755e401 0x757f24a 0x7742762 0x755e47e 0x755e503 0x757f451 0x76e5fc1 0x76e6046 0x76e6124 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:32.812 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc08 /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x157c7 0x10d1d95 0xf741d0 0x9fe4b44 0x9fe500e 0x9fe5281 0x9fe5537 0x9fe5af8 0x9fec307 0x9fec9e7 0xa0d221c 0xa0d68c7 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x722be9f 0x722c8e3 0x77424df 0x755e078 0x757f093 0x752da6e 0x71c9494 0x763159f 0x7533811 0x71c952a 0x76d525e 0x77426e1 0x755e1fe 0x755e2f6 0x755e37c 0x755e401 0x757f24a 0x7742762 0x755e47e 0x755e503 0x757f451 0x76e5fc1 0x76e6046 0x76e6124 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:32.895 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:32.927 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2ce9c36 0x80977e7 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:32.928 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2cea7f3 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:35.134 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:35.134 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:08:35.134 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:08:35.134 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:08:35.134 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:35.134 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:08:35.170 DEBUG:teuthology.orchestra.run.trial053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-24T16:08:35.196 DEBUG:teuthology.orchestra.run.trial053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T16:08:35.348 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: parsing early config 2026-02-24T16:08:35.404 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:35,403 seastar - Reactor backend: linux-aio 2026-02-24T16:08:35.416 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:35,415 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:35.416 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:35,415 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:35.418 INFO:teuthology.orchestra.run.trial053.stderr:==39829==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:08:35.474 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:35,472 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-24T16:08:35.474 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:35,472 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-24T16:08:35.474 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:35,472 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-24T16:08:35.474 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:35,472 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 3 2026-02-24T16:08:35.474 INFO:teuthology.orchestra.run.trial053.stderr:DEBUG 2026-02-24 16:08:35,473 [shard 0:main] seastar - reactor::drain 2026-02-24T16:08:37.541 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:37.541 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:08:37.541 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:08:37.541 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:08:37.541 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:37.541 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:08:37.560 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-24T16:08:37.560 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-24T16:08:37.608 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-24T16:08:37.608 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-24T16:08:37.616 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:37,615 seastar - Reactor backend: linux-aio 2026-02-24T16:08:37.630 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:37,629 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:37.630 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:37,629 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:37.633 INFO:teuthology.orchestra.run.trial053.stderr:==39827==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:08:37.633 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:37,632 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-24T16:08:37.695 INFO:teuthology.orchestra.run.trial053.stderr:DEBUG 2026-02-24 16:08:37,694 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-24T16:08:37.794 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x157c7 0x12772e9 0x1277534 0x10229e0 0x9f31044 0xa0a9b3b 0xa0a9c35 0x7efee32 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7272fae 0x7276b31 0x72f0839 0x7747f18 0x755fef8 0x7585796 0x752dc84 0x72cd4a6 0x7632ed7 0x7534252 0x72cd53c 0x76d5c2f 0x7747fa1 0x755fffa 0x75600f2 0x7560178 0x75601fd 0x758594e 0x7748022 0x756027a 0x75602ff 0x7585b55 0x76e815e 0x76e81e3 0x76e82c1 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:37.794 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xe6ca27 0x9f2edfe 0x9f2efb8 0x9f2f09d 0x9f2f2f9 0x9f2f3ec 0x9f2f4c8 0x9f2f744 0x9f2fceb 0x9f300ef 0x9f303ac 0x9f311f4 0xa0a9b3b 0xa0a9c35 0x7efee32 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7272fae 0x7276b31 0x72f0839 0x7747f18 0x755fef8 0x7585796 0x752dc84 0x72cd4a6 0x7632ed7 0x7534252 0x72cd53c 0x76d5c2f 0x7747fa1 0x755fffa 0x75600f2 0x7560178 0x75601fd 0x758594e 0x7748022 0x756027a 0x75602ff 0x7585b55 0x76e815e 0x76e81e3 0x76e82c1 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:37.794 INFO:teuthology.orchestra.run.trial053.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9b290e96 0xffffffff9b2910bb 0xffffffff9bf50451 0xffffffff9c000ba2 2026-02-24T16:08:37.826 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0xa0b3345 0xa0b4544 0xa0b4964 0xa0d1bdf 0xa0d68c7 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:37.886 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x9fe545d 0x9fe5fe5 0x9fe64e3 0x9fe6b13 0x9fe6c7d 0xa0c203d 0xa0d4e40 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:37.886 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151cc 0x116816a 0xf741c5 0x9fe882e 0x9fe916d 0xa0ce105 0xa0d87eb 0x7bc72d4 0x7efedf5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:37.913 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c2 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:37.970 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2c95a94 0x2cea88a 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:37.971 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:38.132 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfd16a /lib64/libasan.so.8+0xedcb5 0xe6ca27 0xe6cd08 0x77b1595 0x77b1696 0x763e27c 0x7bc7238 0x7efedf5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x722be9f 0x722c8e3 0x77424df 0x755e078 0x757f093 0x752da6e 0x71c9494 0x763159f 0x7533811 0x71c952a 0x76d525e 0x77426e1 0x755e1fe 0x755e2f6 0x755e37c 0x755e401 0x757f24a 0x7742762 0x755e47e 0x755e503 0x757f451 0x76e5fc1 0x76e6046 0x76e6124 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:38.132 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297db /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15e37 0xa0cddc3 0xa0ce31e 0xa0d87eb 0x7bc72d4 0x7eff0d5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x722be9f 0x722c8e3 0x77424df 0x755e078 0x757f093 0x752da6e 0x71c9494 0x763159f 0x7533811 0x71c952a 0x76d525e 0x77426e1 0x755e1fe 0x755e2f6 0x755e37c 0x755e401 0x757f24a 0x7742762 0x755e47e 0x755e503 0x757f451 0x76e5fc1 0x76e6046 0x76e6124 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:38.215 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x12985d /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:38.248 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6583 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:38.248 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1294d2 /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:40.440 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:40.440 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:08:40.440 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:08:40.440 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:08:40.440 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:40.440 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:08:40.480 DEBUG:teuthology.orchestra.run.trial053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-24T16:08:40.505 DEBUG:teuthology.orchestra.run.trial053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T16:08:40.659 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: parsing early config 2026-02-24T16:08:40.712 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:40,711 seastar - Reactor backend: linux-aio 2026-02-24T16:08:40.722 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:40,721 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:40.722 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:40,721 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:40.724 INFO:teuthology.orchestra.run.trial053.stderr:==39893==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:08:40.780 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:40,778 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-24T16:08:40.780 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:40,778 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-24T16:08:40.780 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:40,779 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-24T16:08:40.780 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:40,779 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 3 2026-02-24T16:08:40.780 INFO:teuthology.orchestra.run.trial053.stderr:DEBUG 2026-02-24 16:08:40,779 [shard 0:main] seastar - reactor::drain 2026-02-24T16:08:42.796 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:42.796 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:08:42.796 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:08:42.796 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:08:42.796 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:42.796 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:08:42.816 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-24T16:08:42.816 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-24T16:08:42.863 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-24T16:08:42.864 INFO:teuthology.orchestra.run.trial053.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-24T16:08:42.870 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:42,870 seastar - Reactor backend: linux-aio 2026-02-24T16:08:42.885 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:42,884 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:42.885 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:42,884 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:08:42.888 INFO:teuthology.orchestra.run.trial053.stderr:==39891==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:08:42.888 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:08:42,888 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-24T16:08:42.949 INFO:teuthology.orchestra.run.trial053.stderr:DEBUG 2026-02-24 16:08:42,948 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-24T16:08:43.047 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0xbab517 0x10d1c9b 0xf741d0 0x9fe4d11 0x9fe500e 0x9fe5281 0x9fe6fa7 0x9ff71a5 0x9ff75b7 0xa0c19f2 0xa0c1e26 0xa0c21b9 0xa0d4e40 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7272fae 0x7276b31 0x72f0839 0x7747f18 0x755fef8 0x7585796 0x752dc84 0x72cd4a6 0x7632ed7 0x7534252 0x72cd53c 0x76d5c2f 0x7747fa1 0x755fffa 0x75600f2 0x7560178 0x75601fd 0x758594e 0x7748022 0x756027a 0x75602ff 0x7585b55 0x76e815e 0x76e81e3 0x76e82c1 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:43.048 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x191d45 /lib64/libasan.so.8+0xc748 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0xbf5bf1 0xbf5dfa 0xbf6337 0xd3353e 0x1973fc6 0xa0b45bf 0xa0b4964 0xa0d1bdf 0xa0d68c7 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7272fae 0x7276b31 0x72f0839 0x7747f18 0x755fef8 0x7585796 0x752dc84 0x72cd4a6 0x7632ed7 0x7534252 0x72cd53c 0x76d5c2f 0x7747fa1 0x755fffa 0x75600f2 0x7560178 0x75601fd 0x758594e 0x7748022 0x756027a 0x75602ff 0x7585b55 0x76e815e 0x76e81e3 0x76e82c1 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:43.048 INFO:teuthology.orchestra.run.trial053.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9b6621f0 0xffffffff9b663603 0xffffffff9b5cc8ed 0xffffffff9b5d4bab 0xffffffff9b5d500b 0xffffffff9b2910d2 0xffffffff9bf50451 0xffffffff9c000ba2 2026-02-24T16:08:43.080 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x104e00 /lib64/libasan.so.8+0xc7a1 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9ec9adb 0xa09aab6 0xa09abe4 0xa0cdb7b 0xa0ce31e 0xa0d87eb 0x7bc72d4 0x7eff0d5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:43.139 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x341fba3 0x9fe526f 0x9fe5537 0x9fe5af8 0x9fec307 0x9fec9e7 0xa0d221c 0xa0d68c7 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:43.140 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297e4 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x116816a 0xf741c5 0x9fe956a 0x9fe9817 0xa0d1d59 0xa0d68c7 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x7273c89 0x781ca8c 0x781cbe0 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:43.165 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x80977ca 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:43.224 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1294d2 /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x2cea8e9 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:43.226 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2c95a94 0x2cea88a 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:43.388 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1294d6 /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x7f51719 0x7ebcfa0 0xa0d8806 0x7bc72d4 0x7eff0d5 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x722be9f 0x722c8e3 0x77424df 0x755e078 0x757f093 0x752da6e 0x71c9494 0x763159f 0x7533811 0x71c952a 0x76d525e 0x77426e1 0x755e1fe 0x755e2f6 0x755e37c 0x755e401 0x757f24a 0x7742762 0x755e47e 0x755e503 0x757f451 0x76e5fc1 0x76e6046 0x76e6124 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:43.388 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b364 /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xba66a7 0x10d1d1e 0xf741d0 0x9fe4b44 0x9fe500e 0x9fe5281 0x9fe5537 0x9fe5fe5 0x9fe64e3 0x9fe6b13 0x9fe6c7d 0xa0c203d 0xa0d4e40 0xa096e39 0xa095e39 0x7eff1a0 0x7f0addf 0x7d0df14 0x7d43a07 0x7492021 0x722be9f 0x722c8e3 0x77424df 0x755e078 0x757f093 0x752da6e 0x71c9494 0x763159f 0x7533811 0x71c952a 0x76d525e 0x77426e1 0x755e1fe 0x755e2f6 0x755e37c 0x755e401 0x757f24a 0x7742762 0x755e47e 0x755e503 0x757f451 0x76e5fc1 0x76e6046 0x76e6124 0x77428e2 0x7699a68 0x784409e 0x787bf26 0x76e6210 0x77b2de2 0x78d6e12 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:43.471 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2c95a94 0x2cea88a 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fbc5e 0x9f82d83 0x9f835be 0xf2905b /lib64/libc.so.6+0x2a60f /lib64/libc.so.6+0x2a6bf 0xb83e94 2026-02-24T16:08:43.504 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2c95a94 0x2cea88a 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:43.504 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 65 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa2130ab 0xa0226c9 0xa06f8ed 0xa246ca6 0xa246f14 0xa24705c 0xa24751b /lib64/libc.so.6+0x3fc2f 0x2cea6d5 0x80977b9 0x81685ee 0x8168e55 0x8166af7 0x7b56e2f 0x7b57b24 0x7c6a1c6 0x7b2c212 0x7b8b1ca 0x7c1c577 0x7c1c7f0 0x7c56199 0x7c562f8 0x7c6a329 0x7b52948 0x7de7e59 0x7c77990 0x7db8dca 0x76ae866 0x76bcc3b 0x776718f 0x790351c 0xa25f109 0xa1c54ec 0xa28b9f3 0xa2fa441 0xa2fdd0a 0xa2fe386 0x2967283 0xa91b790 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:08:45.652 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:45.652 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:08:45.652 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:08:45.652 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:08:45.652 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:08:45.652 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:08:45.689 DEBUG:teuthology.orchestra.run.trial053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-24T16:08:45.714 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-24T16:08:45.715 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:45.715 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-24T16:08:45.779 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:45.779 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-24T16:08:45.843 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:45.843 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-24T16:08:45.907 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:45.907 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-24T16:08:45.972 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:45.972 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-24T16:08:46.035 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:46.036 DEBUG:teuthology.orchestra.run.trial053:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-24T16:08:46.092 INFO:tasks.ceph:Adding keys to all mons... 2026-02-24T16:08:46.092 DEBUG:teuthology.orchestra.run.trial053:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T16:08:46.155 INFO:teuthology.orchestra.run.trial053.stdout:[mgr.x] 2026-02-24T16:08:46.155 INFO:teuthology.orchestra.run.trial053.stdout: key = AQD1zJ1pntK5DBAAFq0UKiv4G4Tvv9RFw1I2QQ== 2026-02-24T16:08:46.155 INFO:teuthology.orchestra.run.trial053.stdout:[osd.0] 2026-02-24T16:08:46.155 INFO:teuthology.orchestra.run.trial053.stdout: key = AQD7zJ1pQzsoBBAA0Dx5DLOmarKOfwYkBC1pUA== 2026-02-24T16:08:46.155 INFO:teuthology.orchestra.run.trial053.stdout:[osd.1] 2026-02-24T16:08:46.155 INFO:teuthology.orchestra.run.trial053.stdout: key = AQAAzZ1pO+itFhAA4rifCFdeUqU34MQ/pV8Axg== 2026-02-24T16:08:46.155 INFO:teuthology.orchestra.run.trial053.stdout:[osd.2] 2026-02-24T16:08:46.155 INFO:teuthology.orchestra.run.trial053.stdout: key = AQAFzZ1pgEeiKRAAlRt5n2P+qKSxe+ElVD+gRg== 2026-02-24T16:08:46.155 INFO:teuthology.orchestra.run.trial053.stdout:[osd.3] 2026-02-24T16:08:46.156 INFO:teuthology.orchestra.run.trial053.stdout: key = AQAKzZ1pZEbEOBAAQy4VLoHwaoPJvGZfRCDAeg== 2026-02-24T16:08:46.156 INFO:teuthology.orchestra.run.trial053.stdout:[client.0] 2026-02-24T16:08:46.156 INFO:teuthology.orchestra.run.trial053.stdout: key = AQD1zJ1pt5lhDxAAif5DMs4xACizwOz1by0HFA== 2026-02-24T16:08:46.157 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T16:08:46.246 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T16:08:46.294 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T16:08:46.342 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T16:08:46.390 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T16:08:46.438 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T16:08:46.488 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-24T16:08:46.488 DEBUG:teuthology.orchestra.run.trial053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-24T16:08:46.513 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T16:08:46.599 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:46.597+0000 7f0a4e895c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.599 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:46.597+0000 7f0a4e895c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.611 DEBUG:teuthology.orchestra.run.trial053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-24T16:08:46.635 DEBUG:teuthology.orchestra.run.trial053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T16:08:46.691 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-24T16:08:46.691 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-24T16:08:46.692 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-24T16:08:46.733 INFO:tasks.ceph.mon.a:Started 2026-02-24T16:08:46.733 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-24T16:08:46.734 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-24T16:08:46.734 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-24T16:08:46.736 INFO:tasks.ceph.mgr.x:Started 2026-02-24T16:08:46.736 DEBUG:tasks.ceph:set 0 configs 2026-02-24T16:08:46.737 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph --cluster ceph config dump 2026-02-24T16:08:46.798 INFO:tasks.ceph.mon.a.trial053.stderr:2026-02-24T16:08:46.796+0000 7f5e33cd1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.798 INFO:tasks.ceph.mon.a.trial053.stderr:2026-02-24T16:08:46.796+0000 7f5e33cd1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.798 INFO:tasks.ceph.mon.a.trial053.stderr:2026-02-24T16:08:46.796+0000 7f5e33cd1c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.800 INFO:tasks.ceph.mgr.x.trial053.stderr:2026-02-24T16:08:46.799+0000 7f0c7d82cfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.812 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:46.809+0000 7f70584cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.816 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:46.815+0000 7f70584cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.849 INFO:teuthology.orchestra.run.trial053.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T16:08:46.857 INFO:tasks.ceph:Setting crush tunables to default 2026-02-24T16:08:46.857 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph --cluster ceph osd crush tunables default 2026-02-24T16:08:46.931 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:46.927+0000 7feeed6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.933 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:46.932+0000 7feeed6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:46.968 INFO:teuthology.orchestra.run.trial053.stderr:adjusted tunables profile to default 2026-02-24T16:08:46.975 INFO:tasks.ceph:check_enable_crimson: True 2026-02-24T16:08:46.976 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-24T16:08:46.976 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-24T16:08:47.004 INFO:tasks.ceph.mgr.x.trial053.stderr:2026-02-24T16:08:47.003+0000 7f0c7d82cfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:47.004 INFO:tasks.ceph.mgr.x.trial053.stderr:2026-02-24T16:08:47.003+0000 7f0c7d82cfc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:47.050 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:47.046+0000 7efe09f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:47.052 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:47.051+0000 7efe09f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:47.090 INFO:tasks.ceph.mon.a.trial053.stderr:2026-02-24T16:08:47.089+0000 7f5e2b3f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-24T16:08:47.091 INFO:tasks.ceph.mon.a.trial053.stderr:Please be aware that this feature is experimental, untested, 2026-02-24T16:08:47.091 INFO:tasks.ceph.mon.a.trial053.stderr:unsupported, and may result in data corruption, data loss, 2026-02-24T16:08:47.091 INFO:tasks.ceph.mon.a.trial053.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-24T16:08:47.091 INFO:tasks.ceph.mon.a.trial053.stderr:feature with important data. 2026-02-24T16:08:47.091 INFO:tasks.ceph.mon.a.trial053.stderr: 2026-02-24T16:08:47.836 INFO:tasks.ceph.mgr.x.trial053.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T16:08:47.836 INFO:tasks.ceph.mgr.x.trial053.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T16:08:47.836 INFO:tasks.ceph.mgr.x.trial053.stderr: from numpy import show_config as show_numpy_config 2026-02-24T16:08:47.979 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-24T16:08:47.980 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:47.980 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-24T16:08:48.044 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:48.045 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-24T16:08:48.109 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:48.109 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-24T16:08:48.173 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:08:48.173 DEBUG:teuthology.orchestra.run.trial053:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-24T16:08:48.239 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph --cluster ceph osd new dba280e4-1777-43ce-8051-4b7a6cefe599 0 2026-02-24T16:08:48.354 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:48.348+0000 7f6803a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:48.355 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:48.353+0000 7f6803a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:48.394 INFO:teuthology.orchestra.run.trial053.stdout:0 2026-02-24T16:08:48.402 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph --cluster ceph osd new 1b6eb159-3f62-4730-8d91-940c1dd852dd 1 2026-02-24T16:08:48.477 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:48.471+0000 7f710625a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:48.479 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:48.477+0000 7f710625a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:48.517 INFO:teuthology.orchestra.run.trial053.stdout:1 2026-02-24T16:08:48.528 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph --cluster ceph osd new f00a93d9-2c45-428b-98de-89b05ea2ee94 2 2026-02-24T16:08:48.601 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:48.596+0000 7f358b45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:48.603 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:48.601+0000 7f358b45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:48.642 INFO:teuthology.orchestra.run.trial053.stdout:2 2026-02-24T16:08:48.650 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph --cluster ceph osd new 5526503d-de9b-4bf8-b9a0-a31f664936c9 3 2026-02-24T16:08:48.723 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:48.718+0000 7ff698d93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:48.726 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:48.724+0000 7ff698d93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:48.764 INFO:teuthology.orchestra.run.trial053.stdout:3 2026-02-24T16:08:48.773 DEBUG:teuthology.orchestra.run.trial053:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-24T16:08:48.801 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-24T16:08:48.801 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-24T16:08:48.843 INFO:tasks.ceph.osd.0:Started 2026-02-24T16:08:48.843 DEBUG:teuthology.orchestra.run.trial053:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-24T16:08:48.907 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-24T16:08:48.908 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-24T16:08:48.951 INFO:tasks.ceph.osd.1:Started 2026-02-24T16:08:48.951 DEBUG:teuthology.orchestra.run.trial053:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-24T16:08:48.978 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-24T16:08:48.978 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-24T16:08:49.021 INFO:tasks.ceph.osd.2:Started 2026-02-24T16:08:49.021 DEBUG:teuthology.orchestra.run.trial053:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-24T16:08:49.047 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-24T16:08:49.047 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-24T16:08:49.089 INFO:tasks.ceph.osd.3:Started 2026-02-24T16:08:49.090 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T16:08:49.170 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:49.165+0000 7f28c9cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:49.172 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:08:49.170+0000 7f28c9cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:49.206 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:08:49.206 INFO:teuthology.orchestra.run.trial053.stdout:{"epoch":7,"fsid":"6abeadec-6aab-4afb-8494-572099c2e04c","created":"2026-02-24T16:08:46.808406+0000","modified":"2026-02-24T16:08:48.763462+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T16:08:48.763462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"dba280e4-1777-43ce-8051-4b7a6cefe599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1b6eb159-3f62-4730-8d91-940c1dd852dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f00a93d9-2c45-428b-98de-89b05ea2ee94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5526503d-de9b-4bf8-b9a0-a31f664936c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T16:08:49.215 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-24T16:08:49.215 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-24T16:08:49.617 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T16:08:49.685 INFO:teuthology.misc.health.trial053.stderr:2026-02-24T16:08:49.680+0000 7f067b446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:49.687 INFO:teuthology.misc.health.trial053.stderr:2026-02-24T16:08:49.685+0000 7f067b446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:49.719 INFO:teuthology.misc.health.trial053.stdout: 2026-02-24T16:08:49.720 INFO:teuthology.misc.health.trial053.stdout:{"epoch":7,"fsid":"6abeadec-6aab-4afb-8494-572099c2e04c","created":"2026-02-24T16:08:46.808406+0000","modified":"2026-02-24T16:08:48.763462+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T16:08:48.763462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"dba280e4-1777-43ce-8051-4b7a6cefe599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1b6eb159-3f62-4730-8d91-940c1dd852dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f00a93d9-2c45-428b-98de-89b05ea2ee94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5526503d-de9b-4bf8-b9a0-a31f664936c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T16:08:49.726 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-24T16:08:50.050 INFO:tasks.ceph.mgr.x.trial053.stderr:2026-02-24T16:08:50.047+0000 7f0b9a3eb640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-24T16:08:56.129 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T16:08:56.195 INFO:teuthology.misc.health.trial053.stderr:2026-02-24T16:08:56.191+0000 7fb1bca3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:56.198 INFO:teuthology.misc.health.trial053.stderr:2026-02-24T16:08:56.196+0000 7fb1bca3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:08:56.314 INFO:teuthology.misc.health.trial053.stdout: 2026-02-24T16:08:56.314 INFO:teuthology.misc.health.trial053.stdout:{"epoch":7,"fsid":"6abeadec-6aab-4afb-8494-572099c2e04c","created":"2026-02-24T16:08:46.808406+0000","modified":"2026-02-24T16:08:48.763462+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T16:08:48.763462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"dba280e4-1777-43ce-8051-4b7a6cefe599","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1b6eb159-3f62-4730-8d91-940c1dd852dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f00a93d9-2c45-428b-98de-89b05ea2ee94","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5526503d-de9b-4bf8-b9a0-a31f664936c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T16:08:56.325 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-24T16:09:02.728 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T16:09:02.796 INFO:teuthology.misc.health.trial053.stderr:2026-02-24T16:09:02.792+0000 7f9270e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:02.799 INFO:teuthology.misc.health.trial053.stderr:2026-02-24T16:09:02.797+0000 7f9270e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:02.914 INFO:teuthology.misc.health.trial053.stdout: 2026-02-24T16:09:02.914 INFO:teuthology.misc.health.trial053.stdout:{"epoch":13,"fsid":"6abeadec-6aab-4afb-8494-572099c2e04c","created":"2026-02-24T16:08:46.808406+0000","modified":"2026-02-24T16:09:02.387201+0000","last_up_change":"2026-02-24T16:09:00.377334+0000","last_in_change":"2026-02-24T16:08:48.763462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T16:09:01.060550+0000","flags":294913,"flags_names":"hashpspool,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba280e4-1777-43ce-8051-4b7a6cefe599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6806","nonce":360737695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6807","nonce":360737695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6815","nonce":360737695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6816","nonce":360737695}]},"public_addr":"10.20.193.53:6806/360737695","cluster_addr":"10.20.193.53:6807/360737695","heartbeat_back_addr":"10.20.193.53:6815/360737695","heartbeat_front_addr":"10.20.193.53:6816/360737695","state":["exists","up"]},{"osd":1,"uuid":"1b6eb159-3f62-4730-8d91-940c1dd852dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6802","nonce":821453193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6805","nonce":821453193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6810","nonce":821453193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6811","nonce":821453193}]},"public_addr":"10.20.193.53:6802/821453193","cluster_addr":"10.20.193.53:6805/821453193","heartbeat_back_addr":"10.20.193.53:6810/821453193","heartbeat_front_addr":"10.20.193.53:6811/821453193","state":["exists","up"]},{"osd":2,"uuid":"f00a93d9-2c45-428b-98de-89b05ea2ee94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6813","nonce":1170288352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6812","nonce":1170288352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6820","nonce":1170288352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6819","nonce":1170288352}]},"public_addr":"10.20.193.53:6813/1170288352","cluster_addr":"10.20.193.53:6812/1170288352","heartbeat_back_addr":"10.20.193.53:6820/1170288352","heartbeat_front_addr":"10.20.193.53:6819/1170288352","state":["exists","up"]},{"osd":3,"uuid":"5526503d-de9b-4bf8-b9a0-a31f664936c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6804","nonce":3103081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6803","nonce":3103081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6809","nonce":3103081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6808","nonce":3103081419}]},"public_addr":"10.20.193.53:6804/3103081419","cluster_addr":"10.20.193.53:6803/3103081419","heartbeat_back_addr":"10.20.193.53:6809/3103081419","heartbeat_front_addr":"10.20.193.53:6808/3103081419","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T16:09:02.925 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-24T16:09:02.925 INFO:tasks.ceph:Creating RBD pool 2026-02-24T16:09:02.925 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-24T16:09:03.000 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:02.995+0000 7fd2af30b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:03.003 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:03.002+0000 7fd2af30b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:03.396 INFO:teuthology.orchestra.run.trial053.stderr:pool 'rbd' created 2026-02-24T16:09:03.410 DEBUG:teuthology.orchestra.run.trial053:> rbd --cluster ceph pool init rbd 2026-02-24T16:09:03.451 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:03.450+0000 7f343a00e240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:03.451 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:03.450+0000 7f343a00e240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:03.454 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:03.453+0000 7f343a00e240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:06.436 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-24T16:09:06.437 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-24T16:09:06.438 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-24T16:09:06.552 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:06.548+0000 7f63f3ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:06.555 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:06.554+0000 7f63f3ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:06.670 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:09:06.679 INFO:teuthology.orchestra.run.trial053.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-24T16:09:06.679 INFO:tasks.ceph_manager:config epoch is 1 2026-02-24T16:09:06.679 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T16:09:06.679 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-24T16:09:06.680 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-24T16:09:06.754 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:06.751+0000 7f52b36cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:06.757 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:06.756+0000 7f52b36cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:06.900 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:09:06.908 INFO:teuthology.orchestra.run.trial053.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6800","nonce":2487295246},{"type":"v1","addr":"10.20.193.53:6801","nonce":2487295246}]},"active_addr":"10.20.193.53:6801/2487295246","active_change":"2026-02-24T16:08:49.043588+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.53:0","nonce":142736208}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.53:0","nonce":3360832872}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.53:0","nonce":2266508105}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.53:0","nonce":1023209577}]}]} 2026-02-24T16:09:06.911 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-24T16:09:06.911 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-24T16:09:06.912 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T16:09:06.987 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:06.984+0000 7f8c5d50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:06.989 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:06.988+0000 7f8c5d50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.100 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:09:07.100 INFO:teuthology.orchestra.run.trial053.stdout:{"epoch":17,"fsid":"6abeadec-6aab-4afb-8494-572099c2e04c","created":"2026-02-24T16:08:46.808406+0000","modified":"2026-02-24T16:09:06.402598+0000","last_up_change":"2026-02-24T16:09:00.377334+0000","last_in_change":"2026-02-24T16:08:48.763462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T16:09:01.060550+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T16:09:03.115624+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba280e4-1777-43ce-8051-4b7a6cefe599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6806","nonce":360737695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6807","nonce":360737695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6815","nonce":360737695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6816","nonce":360737695}]},"public_addr":"10.20.193.53:6806/360737695","cluster_addr":"10.20.193.53:6807/360737695","heartbeat_back_addr":"10.20.193.53:6815/360737695","heartbeat_front_addr":"10.20.193.53:6816/360737695","state":["exists","up"]},{"osd":1,"uuid":"1b6eb159-3f62-4730-8d91-940c1dd852dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6802","nonce":821453193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6805","nonce":821453193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6810","nonce":821453193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6811","nonce":821453193}]},"public_addr":"10.20.193.53:6802/821453193","cluster_addr":"10.20.193.53:6805/821453193","heartbeat_back_addr":"10.20.193.53:6810/821453193","heartbeat_front_addr":"10.20.193.53:6811/821453193","state":["exists","up"]},{"osd":2,"uuid":"f00a93d9-2c45-428b-98de-89b05ea2ee94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6813","nonce":1170288352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6812","nonce":1170288352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6820","nonce":1170288352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6819","nonce":1170288352}]},"public_addr":"10.20.193.53:6813/1170288352","cluster_addr":"10.20.193.53:6812/1170288352","heartbeat_back_addr":"10.20.193.53:6820/1170288352","heartbeat_front_addr":"10.20.193.53:6819/1170288352","state":["exists","up"]},{"osd":3,"uuid":"5526503d-de9b-4bf8-b9a0-a31f664936c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6804","nonce":3103081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6803","nonce":3103081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6809","nonce":3103081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6808","nonce":3103081419}]},"public_addr":"10.20.193.53:6804/3103081419","cluster_addr":"10.20.193.53:6803/3103081419","heartbeat_back_addr":"10.20.193.53:6809/3103081419","heartbeat_front_addr":"10.20.193.53:6808/3103081419","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T16:09:07.110 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-24T16:09:07.110 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T16:09:07.185 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.182+0000 7f9523393640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.188 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.187+0000 7f9523393640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.299 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:09:07.299 INFO:teuthology.orchestra.run.trial053.stdout:{"epoch":17,"fsid":"6abeadec-6aab-4afb-8494-572099c2e04c","created":"2026-02-24T16:08:46.808406+0000","modified":"2026-02-24T16:09:06.402598+0000","last_up_change":"2026-02-24T16:09:00.377334+0000","last_in_change":"2026-02-24T16:08:48.763462+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T16:09:01.060550+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T16:09:03.115624+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba280e4-1777-43ce-8051-4b7a6cefe599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6806","nonce":360737695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6807","nonce":360737695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6815","nonce":360737695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6816","nonce":360737695}]},"public_addr":"10.20.193.53:6806/360737695","cluster_addr":"10.20.193.53:6807/360737695","heartbeat_back_addr":"10.20.193.53:6815/360737695","heartbeat_front_addr":"10.20.193.53:6816/360737695","state":["exists","up"]},{"osd":1,"uuid":"1b6eb159-3f62-4730-8d91-940c1dd852dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6802","nonce":821453193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6805","nonce":821453193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6810","nonce":821453193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6811","nonce":821453193}]},"public_addr":"10.20.193.53:6802/821453193","cluster_addr":"10.20.193.53:6805/821453193","heartbeat_back_addr":"10.20.193.53:6810/821453193","heartbeat_front_addr":"10.20.193.53:6811/821453193","state":["exists","up"]},{"osd":2,"uuid":"f00a93d9-2c45-428b-98de-89b05ea2ee94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6813","nonce":1170288352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6812","nonce":1170288352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6820","nonce":1170288352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6819","nonce":1170288352}]},"public_addr":"10.20.193.53:6813/1170288352","cluster_addr":"10.20.193.53:6812/1170288352","heartbeat_back_addr":"10.20.193.53:6820/1170288352","heartbeat_front_addr":"10.20.193.53:6819/1170288352","state":["exists","up"]},{"osd":3,"uuid":"5526503d-de9b-4bf8-b9a0-a31f664936c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6804","nonce":3103081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6803","nonce":3103081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6809","nonce":3103081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6808","nonce":3103081419}]},"public_addr":"10.20.193.53:6804/3103081419","cluster_addr":"10.20.193.53:6803/3103081419","heartbeat_back_addr":"10.20.193.53:6809/3103081419","heartbeat_front_addr":"10.20.193.53:6808/3103081419","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T16:09:07.308 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-24T16:09:07.309 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-24T16:09:07.309 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-24T16:09:07.310 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-24T16:09:07.391 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.387+0000 7fd55b65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.392 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.387+0000 7fee2470b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.392 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.389+0000 7f438abc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.393 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.389+0000 7f55de8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.394 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.393+0000 7fd55b65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.394 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.393+0000 7fee2470b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.395 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.394+0000 7f438abc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.396 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.395+0000 7f55de8cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.413 INFO:teuthology.orchestra.run.trial053.stdout:47244640263 2026-02-24T16:09:07.413 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-24T16:09:07.414 INFO:teuthology.orchestra.run.trial053.stdout:47244640263 2026-02-24T16:09:07.414 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-24T16:09:07.415 INFO:teuthology.orchestra.run.trial053.stdout:47244640263 2026-02-24T16:09:07.415 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-24T16:09:07.416 INFO:teuthology.orchestra.run.trial053.stdout:42949672968 2026-02-24T16:09:07.417 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-24T16:09:07.537 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.534+0000 7f1c8865a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.538 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.534+0000 7efe24d9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.538 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.534+0000 7f62edc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.538 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.534+0000 7f4a24f93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.540 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.539+0000 7f1c8865a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.540 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.539+0000 7f4a24f93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.541 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.540+0000 7f62edc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.541 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.540+0000 7efe24d9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.653 INFO:teuthology.orchestra.run.trial053.stdout:47244640263 2026-02-24T16:09:07.657 INFO:teuthology.orchestra.run.trial053.stdout:47244640263 2026-02-24T16:09:07.661 INFO:teuthology.orchestra.run.trial053.stdout:47244640263 2026-02-24T16:09:07.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640263 for osd.2 2026-02-24T16:09:07.665 INFO:teuthology.orchestra.run.trial053.stdout:42949672968 2026-02-24T16:09:07.665 DEBUG:teuthology.parallel:result is None 2026-02-24T16:09:07.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640263 for osd.0 2026-02-24T16:09:07.669 DEBUG:teuthology.parallel:result is None 2026-02-24T16:09:07.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640263 got 47244640263 for osd.1 2026-02-24T16:09:07.673 DEBUG:teuthology.parallel:result is None 2026-02-24T16:09:07.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.3 2026-02-24T16:09:07.675 DEBUG:teuthology.parallel:result is None 2026-02-24T16:09:07.676 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T16:09:07.676 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T16:09:07.792 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.789+0000 7fe717c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.795 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.794+0000 7fe717c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.905 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:09:07.906 INFO:teuthology.orchestra.run.trial053.stderr:dumped all 2026-02-24T16:09:07.914 INFO:teuthology.orchestra.run.trial053.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2026-02-24T16:09:07.406126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2656,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209188256,"statfs":{"total":214211493888,"available":214208774144,"internally_reserved":0,"allocated":2719744,"data_stored":2719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.006471"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.415985+0000","last_change":"2026-02-24T16:09:06.419766+0000","last_active":"2026-02-24T16:09:06.415985+0000","last_peered":"2026-02-24T16:09:06.415985+0000","last_clean":"2026-02-24T16:09:06.415985+0000","last_became_active":"2026-02-24T16:09:04.464847+0000","last_became_peered":"2026-02-24T16:09:04.464847+0000","last_unstale":"2026-02-24T16:09:06.415985+0000","last_undegraded":"2026-02-24T16:09:06.415985+0000","last_fullsized":"2026-02-24T16:09:06.415985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.414204+0000","last_change":"2026-02-24T16:09:06.417281+0000","last_active":"2026-02-24T16:09:06.414204+0000","last_peered":"2026-02-24T16:09:06.414204+0000","last_clean":"2026-02-24T16:09:06.414204+0000","last_became_active":"2026-02-24T16:09:04.433623+0000","last_became_peered":"2026-02-24T16:09:04.433623+0000","last_unstale":"2026-02-24T16:09:06.414204+0000","last_undegraded":"2026-02-24T16:09:06.414204+0000","last_fullsized":"2026-02-24T16:09:06.414204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.415795+0000","last_change":"2026-02-24T16:09:06.421528+0000","last_active":"2026-02-24T16:09:06.415795+0000","last_peered":"2026-02-24T16:09:06.415795+0000","last_clean":"2026-02-24T16:09:06.415795+0000","last_became_active":"2026-02-24T16:09:04.444473+0000","last_became_peered":"2026-02-24T16:09:04.444473+0000","last_unstale":"2026-02-24T16:09:06.415795+0000","last_undegraded":"2026-02-24T16:09:06.415795+0000","last_fullsized":"2026-02-24T16:09:06.415795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.414458+0000","last_change":"2026-02-24T16:09:06.418542+0000","last_active":"2026-02-24T16:09:06.414458+0000","last_peered":"2026-02-24T16:09:06.414458+0000","last_clean":"2026-02-24T16:09:06.414458+0000","last_became_active":"2026-02-24T16:09:04.446265+0000","last_became_peered":"2026-02-24T16:09:04.446265+0000","last_unstale":"2026-02-24T16:09:06.414458+0000","last_undegraded":"2026-02-24T16:09:06.414458+0000","last_fullsized":"2026-02-24T16:09:06.414458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.421807+0000","last_change":"2026-02-24T16:09:06.421807+0000","last_active":"2026-02-24T16:09:06.421807+0000","last_peered":"2026-02-24T16:09:06.421807+0000","last_clean":"2026-02-24T16:09:06.421807+0000","last_became_active":"2026-02-24T16:09:04.437708+0000","last_became_peered":"2026-02-24T16:09:04.437708+0000","last_unstale":"2026-02-24T16:09:06.421807+0000","last_undegraded":"2026-02-24T16:09:06.421807+0000","last_fullsized":"2026-02-24T16:09:06.421807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.412726+0000","last_change":"2026-02-24T16:09:06.416648+0000","last_active":"2026-02-24T16:09:06.412726+0000","last_peered":"2026-02-24T16:09:06.412726+0000","last_clean":"2026-02-24T16:09:06.412726+0000","last_became_active":"2026-02-24T16:09:04.446518+0000","last_became_peered":"2026-02-24T16:09:04.446518+0000","last_unstale":"2026-02-24T16:09:06.412726+0000","last_undegraded":"2026-02-24T16:09:06.412726+0000","last_fullsized":"2026-02-24T16:09:06.412726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.412888+0000","last_change":"2026-02-24T16:09:06.419150+0000","last_active":"2026-02-24T16:09:06.412888+0000","last_peered":"2026-02-24T16:09:06.412888+0000","last_clean":"2026-02-24T16:09:06.412888+0000","last_became_active":"2026-02-24T16:09:04.433486+0000","last_became_peered":"2026-02-24T16:09:04.433486+0000","last_unstale":"2026-02-24T16:09:06.412888+0000","last_undegraded":"2026-02-24T16:09:06.412888+0000","last_fullsized":"2026-02-24T16:09:06.412888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.413256+0000","last_change":"2026-02-24T16:09:06.419216+0000","last_active":"2026-02-24T16:09:06.413256+0000","last_peered":"2026-02-24T16:09:06.413256+0000","last_clean":"2026-02-24T16:09:06.413256+0000","last_became_active":"2026-02-24T16:09:04.441976+0000","last_became_peered":"2026-02-24T16:09:04.441976+0000","last_unstale":"2026-02-24T16:09:06.413256+0000","last_undegraded":"2026-02-24T16:09:06.413256+0000","last_fullsized":"2026-02-24T16:09:06.413256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":87,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.412652+0000","last_change":"2026-02-24T16:09:02.427010+0000","last_active":"2026-02-24T16:09:06.412652+0000","last_peered":"2026-02-24T16:09:06.412652+0000","last_clean":"2026-02-24T16:09:06.412652+0000","last_became_active":"2026-02-24T16:09:02.417583+0000","last_became_peered":"2026-02-24T16:09:02.417583+0000","last_unstale":"2026-02-24T16:09:06.412652+0000","last_undegraded":"2026-02-24T16:09:06.412652+0000","last_fullsized":"2026-02-24T16:09:06.412652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_clean_scrub_stamp":"2026-02-24T16:09:01.383612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160656949248,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297392,"statfs":{"total":53552873472,"available":53552529408,"internally_reserved":0,"allocated":344064,"data_stored":344064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":268,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297460,"statfs":{"total":53552873472,"available":53552599040,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1028,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296700,"statfs":{"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1024,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296704,"statfs":{"total":53552873472,"available":53551824896,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552599040,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53552529408,"internally_reserved":0,"allocated":344064,"data_stored":344064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T16:09:07.915 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T16:09:07.991 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.988+0000 7fa99eb83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:07.993 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:07.992+0000 7fa99eb83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:08.102 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:09:08.103 INFO:teuthology.orchestra.run.trial053.stderr:dumped all 2026-02-24T16:09:08.112 INFO:teuthology.orchestra.run.trial053.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2026-02-24T16:09:07.406126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":2656,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209188256,"statfs":{"total":214211493888,"available":214208774144,"internally_reserved":0,"allocated":2719744,"data_stored":2719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.006471"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.415985+0000","last_change":"2026-02-24T16:09:06.419766+0000","last_active":"2026-02-24T16:09:06.415985+0000","last_peered":"2026-02-24T16:09:06.415985+0000","last_clean":"2026-02-24T16:09:06.415985+0000","last_became_active":"2026-02-24T16:09:04.464847+0000","last_became_peered":"2026-02-24T16:09:04.464847+0000","last_unstale":"2026-02-24T16:09:06.415985+0000","last_undegraded":"2026-02-24T16:09:06.415985+0000","last_fullsized":"2026-02-24T16:09:06.415985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.414204+0000","last_change":"2026-02-24T16:09:06.417281+0000","last_active":"2026-02-24T16:09:06.414204+0000","last_peered":"2026-02-24T16:09:06.414204+0000","last_clean":"2026-02-24T16:09:06.414204+0000","last_became_active":"2026-02-24T16:09:04.433623+0000","last_became_peered":"2026-02-24T16:09:04.433623+0000","last_unstale":"2026-02-24T16:09:06.414204+0000","last_undegraded":"2026-02-24T16:09:06.414204+0000","last_fullsized":"2026-02-24T16:09:06.414204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.415795+0000","last_change":"2026-02-24T16:09:06.421528+0000","last_active":"2026-02-24T16:09:06.415795+0000","last_peered":"2026-02-24T16:09:06.415795+0000","last_clean":"2026-02-24T16:09:06.415795+0000","last_became_active":"2026-02-24T16:09:04.444473+0000","last_became_peered":"2026-02-24T16:09:04.444473+0000","last_unstale":"2026-02-24T16:09:06.415795+0000","last_undegraded":"2026-02-24T16:09:06.415795+0000","last_fullsized":"2026-02-24T16:09:06.415795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.414458+0000","last_change":"2026-02-24T16:09:06.418542+0000","last_active":"2026-02-24T16:09:06.414458+0000","last_peered":"2026-02-24T16:09:06.414458+0000","last_clean":"2026-02-24T16:09:06.414458+0000","last_became_active":"2026-02-24T16:09:04.446265+0000","last_became_peered":"2026-02-24T16:09:04.446265+0000","last_unstale":"2026-02-24T16:09:06.414458+0000","last_undegraded":"2026-02-24T16:09:06.414458+0000","last_fullsized":"2026-02-24T16:09:06.414458+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.421807+0000","last_change":"2026-02-24T16:09:06.421807+0000","last_active":"2026-02-24T16:09:06.421807+0000","last_peered":"2026-02-24T16:09:06.421807+0000","last_clean":"2026-02-24T16:09:06.421807+0000","last_became_active":"2026-02-24T16:09:04.437708+0000","last_became_peered":"2026-02-24T16:09:04.437708+0000","last_unstale":"2026-02-24T16:09:06.421807+0000","last_undegraded":"2026-02-24T16:09:06.421807+0000","last_fullsized":"2026-02-24T16:09:06.421807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.412726+0000","last_change":"2026-02-24T16:09:06.416648+0000","last_active":"2026-02-24T16:09:06.412726+0000","last_peered":"2026-02-24T16:09:06.412726+0000","last_clean":"2026-02-24T16:09:06.412726+0000","last_became_active":"2026-02-24T16:09:04.446518+0000","last_became_peered":"2026-02-24T16:09:04.446518+0000","last_unstale":"2026-02-24T16:09:06.412726+0000","last_undegraded":"2026-02-24T16:09:06.412726+0000","last_fullsized":"2026-02-24T16:09:06.412726+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.412888+0000","last_change":"2026-02-24T16:09:06.419150+0000","last_active":"2026-02-24T16:09:06.412888+0000","last_peered":"2026-02-24T16:09:06.412888+0000","last_clean":"2026-02-24T16:09:06.412888+0000","last_became_active":"2026-02-24T16:09:04.433486+0000","last_became_peered":"2026-02-24T16:09:04.433486+0000","last_unstale":"2026-02-24T16:09:06.412888+0000","last_undegraded":"2026-02-24T16:09:06.412888+0000","last_fullsized":"2026-02-24T16:09:06.412888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.413256+0000","last_change":"2026-02-24T16:09:06.419216+0000","last_active":"2026-02-24T16:09:06.413256+0000","last_peered":"2026-02-24T16:09:06.413256+0000","last_clean":"2026-02-24T16:09:06.413256+0000","last_became_active":"2026-02-24T16:09:04.441976+0000","last_became_peered":"2026-02-24T16:09:04.441976+0000","last_unstale":"2026-02-24T16:09:06.413256+0000","last_undegraded":"2026-02-24T16:09:06.413256+0000","last_fullsized":"2026-02-24T16:09:06.413256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":87,"reported_epoch":17,"state":"active+clean","last_fresh":"2026-02-24T16:09:06.412652+0000","last_change":"2026-02-24T16:09:02.427010+0000","last_active":"2026-02-24T16:09:06.412652+0000","last_peered":"2026-02-24T16:09:06.412652+0000","last_clean":"2026-02-24T16:09:06.412652+0000","last_became_active":"2026-02-24T16:09:02.417583+0000","last_became_peered":"2026-02-24T16:09:02.417583+0000","last_unstale":"2026-02-24T16:09:06.412652+0000","last_undegraded":"2026-02-24T16:09:06.412652+0000","last_fullsized":"2026-02-24T16:09:06.412652+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_clean_scrub_stamp":"2026-02-24T16:09:01.383612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160656949248,"internally_reserved":0,"allocated":1671168,"data_stored":1671168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":336,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297392,"statfs":{"total":53552873472,"available":53552529408,"internally_reserved":0,"allocated":344064,"data_stored":344064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":268,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297460,"statfs":{"total":53552873472,"available":53552599040,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1028,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296700,"statfs":{"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1024,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296704,"statfs":{"total":53552873472,"available":53551824896,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552599040,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53552529408,"internally_reserved":0,"allocated":344064,"data_stored":344064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T16:09:08.112 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T16:09:08.112 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T16:09:08.112 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-24T16:09:08.113 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-24T16:09:08.189 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:08.186+0000 7fe316a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:08.192 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:08.191+0000 7fe316a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:08.329 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:09:08.329 INFO:teuthology.orchestra.run.trial053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T16:09:08.339 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-24T16:09:08.339 INFO:teuthology.run_tasks:Running task ceph_objectstore_tool... 2026-02-24T16:09:08.359 INFO:tasks.ceph_objectstore_tool:crimson_objectstore_tool is True... 2026-02-24T16:09:08.359 DEBUG:tasks.ceph_objectstore_tool:{'crimson_objectstore_tool': True, 'objects': 5, 'pgnum': 8} 2026-02-24T16:09:08.359 DEBUG:tasks.ceph_objectstore_tool:{'help': False, 'version': False, 'archive': '/home/teuthworker/mnt/teuthology/liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial/68165', 'owner': 'scheduled_liucm@soko04.front.sepia.ceph.com', 'block': False, 'name': 'liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial', 'lock': False, 'os_version': None, 'interactive_on_error': False, 'description': 'crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool}', 'suite_path': None, 'verbose': True, 'os_type': None, 'machine_type': 'trial', '': True, 'config': {'archive_path': '/home/teuthworker/mnt/teuthology/liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial/68165', 'branch': 'wip-liucm-shard-redesign-crimson-only', 'description': 'crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '68165', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-liucm-shard-redesign-crimson-only'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}}, 'workunit': {'branch': 'wip-liucm-shard-redesign-crimson-only', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}}, 'owner': 'scheduled_liucm@soko04.front.sepia.ceph.com', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']], 'seed': 9834, 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'wip-liucm-shard-redesign-crimson-only', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d26e5c228e3cdea4d585bcd077f8513a649ab5d1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1', 'targets': {'trial053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBf74I6lQX8UzajKEwZt3MwgC0b+OI5Y40XI9q+Tj/tT3n/qk7h2ip7SWoewfX1ULe7dCNVmpui4N3ZQlGna1xk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(OBJECT_', 'for optimal performance'], 'sha1': 'd26e5c228e3cdea4d585bcd077f8513a649ab5d1', 'cluster': 'ceph'}}, {'ceph_objectstore_tool': {'crimson_objectstore_tool': True, 'objects': 5, 'pgnum': 8}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-24_15:28:57', 'tube': 'trial', 'user': 'liucm', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'}, 'summary': {'success': True, 'owner': 'scheduled_liucm@soko04.front.sepia.ceph.com', 'description': 'crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool}', 'flavor': 'debug'}, 'cluster': Cluster(remotes=[[Remote(name='ubuntu@trial053.front.sepia.ceph.com'), ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']]]), 'do_ship_utilities': False, 'daemons': , 'ceph': {'ceph': Namespace(conf=ConfigObj({'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.53', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'fsid': '6abeadec-6aab-4afb-8494-572099c2e04c'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 3, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd objectstore': 'seastore', 'seastore cachepin size pershard': '64M', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}}), mons={'mon.a': '10.20.193.53'}, fsid='6abeadec-6aab-4afb-8494-572099c2e04c', thrashers=[], watched_processes=[], watchdog=)}, 'disk_config': Namespace(remote_to_roles_to_dev={Remote(name='ubuntu@trial053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}}, remote_to_roles_to_dev_mount_options={Remote(name='ubuntu@trial053.front.sepia.ceph.com'): {'osd.0': ['noatime'], 'osd.1': ['noatime'], 'osd.2': ['noatime'], 'osd.3': ['noatime']}}, remote_to_roles_to_dev_fstype={Remote(name='ubuntu@trial053.front.sepia.ceph.com'): {'osd.0': 'xfs', 'osd.1': 'xfs', 'osd.2': 'xfs', 'osd.3': 'xfs'}}), 'managers': {'ceph': }, 'conf_epoch': 1} 2026-02-24T16:09:08.360 DEBUG:tasks.ceph_objectstore_tool:ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:09:08.360 INFO:tasks.ceph_objectstore_tool:OSDS 2026-02-24T16:09:08.360 INFO:tasks.ceph_objectstore_tool:ubuntu@trial053.front.sepia.ceph.com[mon.a,mgr.x,osd.0,osd.1,osd.2,osd.3,client.0] 2026-02-24T16:09:08.360 INFO:tasks.ceph_objectstore_tool:{Remote(name='ubuntu@trial053.front.sepia.ceph.com'): ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']} 2026-02-24T16:09:08.360 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-24T16:09:08.435 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:08.432+0000 7f5c3fb74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:08.437 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:08.436+0000 7f5c3fb74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:epoch 17 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:fsid 6abeadec-6aab-4afb-8494-572099c2e04c 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:created 2026-02-24T16:08:46.808406+0000 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:modified 2026-02-24T16:09:06.402598+0000 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:crush_version 5 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:full_ratio 0.95 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:backfillfull_ratio 0.9 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:nearfull_ratio 0.85 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:require_min_compat_client luminous 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:min_compat_client jewel 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:require_osd_release tentacle 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:stretch_mode_enabled false 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:allow_crimson=true 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-24T16:09:08.547 INFO:teuthology.orchestra.run.trial053.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-24T16:09:08.548 INFO:teuthology.orchestra.run.trial053.stdout: removed_snaps_queue [2~1] 2026-02-24T16:09:08.548 INFO:teuthology.orchestra.run.trial053.stdout:max_osd 4 2026-02-24T16:09:08.548 INFO:teuthology.orchestra.run.trial053.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599 2026-02-24T16:09:08.548 INFO:teuthology.orchestra.run.trial053.stdout:osd.1 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd 2026-02-24T16:09:08.548 INFO:teuthology.orchestra.run.trial053.stdout:osd.2 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94 2026-02-24T16:09:08.548 INFO:teuthology.orchestra.run.trial053.stdout:osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9 2026-02-24T16:09:08.556 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599', 'osd.1 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd', 'osd.2 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94', 'osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9'] 2026-02-24T16:09:08.556 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-24T16:09:08.631 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:08.628+0000 7f18b4d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:08.633 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:08.632+0000 7f18b4d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:epoch 17 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:fsid 6abeadec-6aab-4afb-8494-572099c2e04c 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:created 2026-02-24T16:08:46.808406+0000 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:modified 2026-02-24T16:09:06.402598+0000 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:crush_version 5 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:full_ratio 0.95 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:backfillfull_ratio 0.9 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:nearfull_ratio 0.85 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:require_min_compat_client luminous 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:min_compat_client jewel 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:require_osd_release tentacle 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:stretch_mode_enabled false 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:allow_crimson=true 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout: removed_snaps_queue [2~1] 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:max_osd 4 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599 2026-02-24T16:09:08.745 INFO:teuthology.orchestra.run.trial053.stdout:osd.1 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd 2026-02-24T16:09:08.746 INFO:teuthology.orchestra.run.trial053.stdout:osd.2 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94 2026-02-24T16:09:08.746 INFO:teuthology.orchestra.run.trial053.stdout:osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9 2026-02-24T16:09:08.754 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599', 'osd.1 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd', 'osd.2 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94', 'osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9'] 2026-02-24T16:09:08.755 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-24T16:09:08.828 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:08.825+0000 7fb055dd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:08.831 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:08.830+0000 7fb055dd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:epoch 17 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:fsid 6abeadec-6aab-4afb-8494-572099c2e04c 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:created 2026-02-24T16:08:46.808406+0000 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:modified 2026-02-24T16:09:06.402598+0000 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:crush_version 5 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:full_ratio 0.95 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:backfillfull_ratio 0.9 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:nearfull_ratio 0.85 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:require_min_compat_client luminous 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:min_compat_client jewel 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:require_osd_release tentacle 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:stretch_mode_enabled false 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:allow_crimson=true 2026-02-24T16:09:08.942 INFO:teuthology.orchestra.run.trial053.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-24T16:09:08.943 INFO:teuthology.orchestra.run.trial053.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-24T16:09:08.943 INFO:teuthology.orchestra.run.trial053.stdout: removed_snaps_queue [2~1] 2026-02-24T16:09:08.943 INFO:teuthology.orchestra.run.trial053.stdout:max_osd 4 2026-02-24T16:09:08.943 INFO:teuthology.orchestra.run.trial053.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599 2026-02-24T16:09:08.943 INFO:teuthology.orchestra.run.trial053.stdout:osd.1 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd 2026-02-24T16:09:08.943 INFO:teuthology.orchestra.run.trial053.stdout:osd.2 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94 2026-02-24T16:09:08.943 INFO:teuthology.orchestra.run.trial053.stdout:osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9 2026-02-24T16:09:08.950 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599', 'osd.1 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd', 'osd.2 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94', 'osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9'] 2026-02-24T16:09:08.951 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-24T16:09:09.025 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:09.022+0000 7f2ed910b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:09.028 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:09.027+0000 7f2ed890a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:09.138 INFO:teuthology.orchestra.run.trial053.stdout:epoch 17 2026-02-24T16:09:09.138 INFO:teuthology.orchestra.run.trial053.stdout:fsid 6abeadec-6aab-4afb-8494-572099c2e04c 2026-02-24T16:09:09.138 INFO:teuthology.orchestra.run.trial053.stdout:created 2026-02-24T16:08:46.808406+0000 2026-02-24T16:09:09.138 INFO:teuthology.orchestra.run.trial053.stdout:modified 2026-02-24T16:09:06.402598+0000 2026-02-24T16:09:09.138 INFO:teuthology.orchestra.run.trial053.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T16:09:09.138 INFO:teuthology.orchestra.run.trial053.stdout:crush_version 5 2026-02-24T16:09:09.138 INFO:teuthology.orchestra.run.trial053.stdout:full_ratio 0.95 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:backfillfull_ratio 0.9 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:nearfull_ratio 0.85 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:require_min_compat_client luminous 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:min_compat_client jewel 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:require_osd_release tentacle 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:stretch_mode_enabled false 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:allow_crimson=true 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout: removed_snaps_queue [2~1] 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:max_osd 4 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:osd.1 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:osd.2 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94 2026-02-24T16:09:09.139 INFO:teuthology.orchestra.run.trial053.stdout:osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9 2026-02-24T16:09:09.147 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599', 'osd.1 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd', 'osd.2 up in weight 1 up_from 11 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94', 'osd.3 up in weight 1 up_from 10 up_thru 14 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9'] 2026-02-24T16:09:09.147 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noout 2026-02-24T16:09:09.225 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:09.220+0000 7f1127bc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:09.227 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:09.226+0000 7f1127bc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:09.414 INFO:teuthology.orchestra.run.trial053.stderr:noout is set 2026-02-24T16:09:09.431 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodown 2026-02-24T16:09:09.506 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:09.502+0000 7f8296011640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:09.508 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:09.507+0000 7f8296011640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:10.414 INFO:teuthology.orchestra.run.trial053.stderr:nodown is set 2026-02-24T16:09:10.430 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config show 2026-02-24T16:09:10.508 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:09:10.508 INFO:teuthology.orchestra.run.trial053.stdout: "name": "osd.0", 2026-02-24T16:09:10.508 INFO:teuthology.orchestra.run.trial053.stdout: "cluster": "ceph", 2026-02-24T16:09:10.508 INFO:teuthology.orchestra.run.trial053.stdout: "admin_socket": "/var/run/ceph/ceph-osd.0.asok", 2026-02-24T16:09:10.508 INFO:teuthology.orchestra.run.trial053.stdout: "admin_socket_mode": "", 2026-02-24T16:09:10.508 INFO:teuthology.orchestra.run.trial053.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "auth_client_required": "cephx, none", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "auth_cluster_required": "cephx", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "auth_debug": "true", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "auth_mon_ticket_ttl": "259200.000000", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "auth_service_required": "cephx", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "auth_service_ticket_ttl": "3600.000000", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "auth_supported": "cephx", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_aio": "true", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_aio_poll_ms": "250", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_aio_reap_max": "16", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_async_discard": "false", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_async_discard_threads": "0", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_block_size": "4096", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_debug_aio": "true", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_debug_discard_sleep": "0", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_debug_inflight_ios": "false", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-24T16:09:10.509 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_enable_discard": "false", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_flock_retry": "3", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_inject_crash": "0", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_ioring": "false", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_ioring_hipri": "false", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_max_discard_length": "2147483648", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bdev_type": "", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_alloc_size": "1048576", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_allocator": "hybrid", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_buffered_io": "true", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_check_for_zeros": "false", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_compact_log_sync": "false", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_max_log_runway": "4194304", 2026-02-24T16:09:10.510 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_max_prefetch": "1048576", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_min_flush_size": "524288", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_min_log_runway": "1048576", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_replay_recovery": "false", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_sync_write": "false", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_allocation_from_file": "true", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_allocator": "hybrid", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_async_db_compaction": "true", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_bdev_label_multi": "true", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_create": "true", 2026-02-24T16:09:10.511 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_db_create": "false", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_db_path": "", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_db_size": "0", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_path": "", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_preallocate_file": "false", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_size": "107374182400", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_wal_create": "false", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_wal_path": "", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_block_wal_size": "100663296", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_bluefs": "true", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_autotune": "true", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_size": "0", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-24T16:09:10.512 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cache_type": "2q", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_clone_cow": "true", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_compression_mode": "none", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_csum_type": "crc32c", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_freelist": "false", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-24T16:09:10.513 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_small_allocations": "0", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_default_buffered_read": "true", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_default_buffered_write": "false", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fail_eio": "false", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-24T16:09:10.514 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_on_mount": "false", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_on_umount": "false", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_ignore_data_csum": "false", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_log_op_age": "5.000000", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_max_alloc_size": "0", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_max_blob_size": "0", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_max_deferred_txc": "32", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_min_alloc_size": "0", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-24T16:09:10.515 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_nid_prealloc": "1024", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_onode_segment_size": "0", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_retry_disk_reads": "3", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_rocksdb_cf": "true", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_spdk_mem": "512", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_tracing": "false", 2026-02-24T16:09:10.516 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_write_v2": "false", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_write_v2_random": "false", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "bluestore_zero_block_detection": "false", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "breakpad": "false", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "ceph_assert_supresssions": "", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-24T16:09:10.517 INFO:teuthology.orchestra.run.trial053.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "cephx_cluster_require_signatures": "false", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "cephx_cluster_require_version": "2", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "cephx_require_signatures": "false", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "cephx_require_version": "2", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "cephx_service_require_signatures": "false", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "cephx_service_require_version": "2", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "cephx_sign_messages": "true", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "chdir": "", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_acl_type": "", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_asio_thread_count": "2", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_cache_mid": "0.750000", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_cache_size": "16384", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_caps_release_delay": "5", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_check_pool_perm": "true", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_debug_force_sync_read": "false", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_debug_getattr_caps": "false", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_debug_inject_features": "", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_debug_inject_tick_delay": "0", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_die_on_failed_remount": "false", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_dirsize_rbytes": "true", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_force_lazyio": "false", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_fs": "", 2026-02-24T16:09:10.518 INFO:teuthology.orchestra.run.trial053.stdout: "client_fscrypt_as": "true", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_inject_release_failure": "false", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_inject_write_delay_secs": "0", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_max_inline_size": "4096", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_mds_namespace": "", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_metadata": "", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_mount_gid": "-1", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_mount_timeout": "300", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_mount_uid": "-1", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_mountpoint": "/", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_notify_timeout": "10", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_oc": "true", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_oc_max_dirty": "104857600", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_oc_max_objects": "1000", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_oc_size": "209715200", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_oc_target_dirty": "8388608", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_permissions": "true", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_quota": "true", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_quota_df": "true", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_readahead_max_bytes": "0", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_readahead_max_periods": "4", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_readahead_min": "131072", 2026-02-24T16:09:10.519 INFO:teuthology.orchestra.run.trial053.stdout: "client_reconnect_stale": "false", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "client_shutdown_timeout": "30", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "client_snapdir": ".snap", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "client_tick_interval": "1", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "client_trace": "", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "client_try_dentry_invalidate": "false", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "client_use_faked_inos": "false", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "client_use_random_mds": "false", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "clog_to_graylog": "false", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "clog_to_graylog_port": "12201", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "clog_to_monitors": "default=true", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "clog_to_syslog": "false", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "clog_to_syslog_level": "info", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "cluster_addr": "-", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "cluster_network": "", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "cluster_network_interface": "", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "compressor_zlib_isal": "false", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "compressor_zlib_level": "5", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "compressor_zlib_winsize": "-15", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "compressor_zstd_level": "1", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_allow_pg_split": "true", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_bluestore_cpu_set": "", 2026-02-24T16:09:10.520 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_bluestore_num_threads": "6", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_cpu_num": "3", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_cpu_set": "", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_osd_obc_lru_size": "10", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_osd_stat_interval": "0", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_poll_mode": "false", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crush_location": "", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crush_location_hook": "", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "crush_location_hook_timeout": "10", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "d4n_writecache_enabled": "false", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "daemonize": "false", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "daos_pool": "tank", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_alienstore": "0/5", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_allow_any_pool_priority": "false", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_asok": "1/5", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_asok_assert_abort": "false", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_asserts_on_shutdown": "true", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_auth": "1/5", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_bdev": "1/3", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_bluefs": "1/5", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_bluestore": "1/5", 2026-02-24T16:09:10.521 INFO:teuthology.orchestra.run.trial053.stdout: "debug_bluestore_compression": "1/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_buffer": "0/1", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_ceph_dedup": "0/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_ceph_exporter": "1/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_cephfs_mirror": "0/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_cephsqlite": "0/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_client": "0/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_compressor": "1/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_context": "0/1", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_crimson_interrupt": "0/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_crush": "1/1", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_crypto": "1/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_cyanstore": "0/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_deliberately_leak_memory": "false", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_disable_randomized_ping": "false", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_dpdk": "1/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_eventtrace": "1/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_filer": "0/1", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_filestore": "1/3", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_finisher": "1/1", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_fuse": "1/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_heartbeat_testing_span": "0", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_heartbeatmap": "1/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_javaclient": "1/5", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_journal": "1/3", 2026-02-24T16:09:10.522 INFO:teuthology.orchestra.run.trial053.stdout: "debug_journaler": "0/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_kstore": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_lockdep": "0/1", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mclock": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mds": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mds_balancer": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mds_locker": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mds_log": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mds_log_expire": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mds_migrator": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mds_quiesce": "3/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_memstore": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mgr": "2/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mgrc": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_mon": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_monc": "20/20", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_ms": "20/20", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_none": "0/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_objclass": "0/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_objectcacher": "0/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_objecter": "0/1", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_optracker": "0/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_osd": "20/20", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_paxos": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_perfcounter": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_prioritycache": "1/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rados": "0/5", 2026-02-24T16:09:10.523 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rbd": "0/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rbd_mirror": "0/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rbd_pwl": "0/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rbd_replay": "0/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_refs": "0/0", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_reserver": "1/1", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_access": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_datacache": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_dbstore": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_dedup": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_flight": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_notification": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_restore": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rgw_sync": "1/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_rocksdb": "4/5", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_backref": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_cache": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_cleaner": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_device": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_epm": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_fixedkv_tree": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_journal": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_lba": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_odata": "20/20", 2026-02-24T16:09:10.524 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_omap": "20/20", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_onode": "20/20", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_t": "20/20", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "debug_seastore_tm": "20/20", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "debug_striper": "0/1", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "debug_test": "0/5", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "debug_throttle": "1/1", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "debug_timer": "0/1", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "debug_tp": "0/5", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "debug_trace": "1/5", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "device_failure_prediction_mode": "none", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "ec_extent_cache_size": "10485760", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "ec_pdw_write_mode": "0", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "enable_availability_tracking": "false", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "err_to_graylog": "false", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "err_to_journald": "false", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "err_to_stderr": "true", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "err_to_syslog": "false", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "event_tracing": "false", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "exporter_addr": "0.0.0.0", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "exporter_cert_file": "", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "exporter_http_port": "9926", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "exporter_key_file": "", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "exporter_prio_limit": "5", 2026-02-24T16:09:10.525 INFO:teuthology.orchestra.run.trial053.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "exporter_sort_metrics": "true", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "exporter_stats_period": "5", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "fake_statfs_for_testing": "0", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "fatal_signal_handlers": "true", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filer_max_purge_ops": "10", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filer_max_truncate_ops": "128", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_apply_finisher_threads": "3", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_blackhole": "false", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_btrfs_clone_range": "true", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_btrfs_snap": "true", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_caller_concurrency": "10", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_collect_device_partition_information": "true", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_commit_timeout": "600.000000", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_debug_inject_read_err": "false", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_debug_omap_check": "false", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_debug_verify_split": "false", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_dump_file": "", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_fadvise": "true", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_fail_eio": "true", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_fd_cache_shards": "16", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_fd_cache_size": "128", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_fiemap": "false", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_fiemap_threshold": "4096", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-24T16:09:10.526 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_inject_stall": "0", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_journal_parallel": "false", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_journal_trailing": "false", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_journal_writeahead": "false", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_kill_at": "0", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_inline_xattrs": "0", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_xattr_value_size": "0", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_merge_threshold": "-10", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_odsync_write": "false", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_omap_backend": "rocksdb", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_omap_backend_path": "", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_ondisk_finisher_threads": "3", 2026-02-24T16:09:10.527 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_op_thread_timeout": "60", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_op_threads": "2", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_punch_hole": "false", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_queue_max_ops": "50", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_seek_data_hole": "false", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_sloppy_crc": "false", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_splice": "false", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_split_multiple": "2", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_split_rand_factor": "20", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_update_to": "1000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-24T16:09:10.528 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_enable": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_xfs_extsize": "false", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "filestore_zfs_snap": "false", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fio_dir": "/tmp/fio", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fsid": "6abeadec-6aab-4afb-8494-572099c2e04c", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_allow_other": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_atomic_o_trunc": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_big_writes": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_debug": "false", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_default_permissions": "false", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_disable_pagecache": "false", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_max_write": "0", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_multithreaded": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_require_active_mds": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_set_user_groups": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_splice_move": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_splice_read": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_splice_write": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "fuse_use_invalidate_cb": "true", 2026-02-24T16:09:10.529 INFO:teuthology.orchestra.run.trial053.stdout: "gss_ktab_client_file": "/var/lib/ceph/osd.0/gss_client_osd.0.ktab", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "gss_target_name": "ceph", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "heartbeat_file": "", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "heartbeat_inject_failure": "0", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "heartbeat_interval": "5", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "host": "", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "inject_early_sigterm": "false", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "jaeger_agent_port": "6799", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "jaeger_tracing_enable": "false", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "journal_aio": "true", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "journal_align_min_size": "65536", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "journal_block_align": "true", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "journal_block_size": "4096", 2026-02-24T16:09:10.530 INFO:teuthology.orchestra.run.trial053.stdout: "journal_dio": "true", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_discard": "false", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_force_aio": "false", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_ignore_corruption": "false", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_max_write_bytes": "10485760", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_max_write_entries": "100", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_replay_from": "0", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_write_header_frequency": "0", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journal_zero_on_create": "true", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journaler_prefetch_periods": "10", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journaler_prezero_periods": "5", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "journaler_write_head_interval": "15", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "key": "", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "keyfile": "", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "keyring": "/var/lib/ceph/osd/ceph-0/keyring", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "librados_thread_count": "2", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "lockdep": "false", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "lockdep_force_backtrace": "false", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "log_coarse_timestamps": "true", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "log_file": "/var/log/ceph/ceph-osd.0.log", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "log_flush_on_exit": "false", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "log_graylog_host": "127.0.0.1", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "log_graylog_port": "12201", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "log_max_new": "1000", 2026-02-24T16:09:10.531 INFO:teuthology.orchestra.run.trial053.stdout: "log_max_recent": "10000", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "log_stderr_prefix": "", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "log_stop_at_utilization": "0.970000", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "log_to_file": "true", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "log_to_graylog": "false", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "log_to_journald": "false", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "log_to_stderr": "false", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "log_to_syslog": "false", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "max_rotating_auth_attempts": "10", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_action_on_write_error": "1", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_allow_async_dirops": "true", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_allow_batched_ops": "true", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_alternate_name_max": "8192", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_asio_thread_count": "2", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_export_pin": "true", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_fragment_dirs": "true", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_fragment_interval": "5", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_interval": "10", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_max": "-1", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_max_until": "-1", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_merge_size": "50", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_midchunk": "0.300000", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-24T16:09:10.532 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_min_start": "0.200000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_minchunk": "0.001000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_mode": "0", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_need_max": "1.200000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_need_min": "0.800000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_overload_epochs": "2", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_split_bits": "3", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_split_size": "10000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_target_decay": "10.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_beacon_grace": "15.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_beacon_interval": "4.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_mid": "0.700000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_quiesce_delay": "0", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_release_free_interval": "10", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_reservation": "0.050000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-24T16:09:10.533 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_trim_interval": "1", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cache_trim_threshold": "262144", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_client_prealloc_inos": "1000", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_connect_bootstrapping": "false", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_damage_table_max_entries": "10000", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_data": "/var/lib/ceph/mds/ceph-0", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_debug_auth_pins": "false", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_debug_frag": "false", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_debug_scatterstat": "false", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_debug_subtrees": "false", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_decay_halflife": "5.000000", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_default_dir_hash": "2", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_defer_session_stale": "true", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_deny_all_reconnect": "false", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_dir_keys_per_op": "16384", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_dir_max_commit_size": "10", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_dir_max_entries": "0", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_dir_prefetch": "true", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_dump_cache_on_map": "false", 2026-02-24T16:09:10.534 INFO:teuthology.orchestra.run.trial053.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_early_reply": "true", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_enable_op_tracker": "true", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_enforce_unique_name": "true", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_export_ephemeral_random": "true", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_health_summarize_threshold": "10", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_inject_health_dummy": "false", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_inject_migrator_session_race": "false", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_join_fs": "", 2026-02-24T16:09:10.535 INFO:teuthology.orchestra.run.trial053.stdout: "mds_journal_format": "1", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_create_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_dirfrag_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_export_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_import_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_journal_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_journal_expire_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_journal_replay_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_link_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_mdstable_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_openc_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_rename_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_kill_shutdown_at": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_event_large_threshold": "524288", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_events_per_segment": "1024", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_max_events": "-1", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_max_segments": "128", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_pause": "false", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_segment_size": "0", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_trim_threshold": "128", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_log_warn_factor": "2.000000", 2026-02-24T16:09:10.536 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_caps_per_client": "1048576", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_completed_flushes": "100000", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_completed_requests": "100000", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_export_size": "20971520", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_file_recover": "32", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_purge_files": "64", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_purge_ops": "8192", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_max_snaps_per_dir": "100", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_metrics_update_interval": "2", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_min_caps_per_client": "100", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_min_caps_working_set": "10000", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_numa_node": "-1", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_op_complaint_time": "30.000000", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_op_history_duration": "600", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_op_history_size": "20", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_op_history_slow_op_size": "20", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_op_log_threshold": "5", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_ping_grace": "15", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_ping_interval": "5", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_recall_max_caps": "30000", 2026-02-24T16:09:10.537 INFO:teuthology.orchestra.run.trial053.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_recall_warning_threshold": "262144", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_replay_interval": "1.000000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_root_ino_gid": "0", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_root_ino_uid": "0", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_scrub_stats_review_period": "1", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_shutdown_check": "0", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_skip_ino": "0", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-24T16:09:10.538 INFO:teuthology.orchestra.run.trial053.stdout: "mds_snap_max_uid": "4294967294", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_snap_min_uid": "0", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_snap_rstat": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_standby_replay_damaged": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_symlink_recovery": "true", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_thrash_exports": "0", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_thrash_fragments": "0", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_tick_interval": "5.000000", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_valgrind_exit": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_verify_backtrace": "1", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_verify_scatter": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mds_wipe_sessions": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mempool_debug": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "memstore_device_bytes": "1073741824", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "memstore_page_set": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "memstore_page_size": "65536", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_client_bytes": "134217728", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_client_messages": "512", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-0", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_disabled_modules": "", 2026-02-24T16:09:10.539 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_enable_op_tracker": "true", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_max_pg_creating": "1024", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_max_pg_num_change": "128", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_mds_bytes": "134217728", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_mds_messages": "128", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_mon_bytes": "134217728", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_mon_messages": "128", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_op_history_duration": "600", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_op_history_size": "20", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_op_log_threshold": "5", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_osd_bytes": "536870912", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_osd_messages": "8192", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_pool": "true", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_standby_modules": "true", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_stats_period": "5", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_stats_threshold": "5", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_tick_period": "2", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-24T16:09:10.540 INFO:teuthology.orchestra.run.trial053.stdout: "mon_allow_pool_delete": "true", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_allow_pool_size_one": "true", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_auth_validate_all_caps": "true", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_bytes": "104857600", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_directed_command_retry": "2", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_hunt_on_resend": "true", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_hunt_parallel": "3", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_log_interval": "1.000000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_ping_interval": "10.000000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_client_target_rank": "-1", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_level": "debug", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_to_file": "true", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-24T16:09:10.541 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_to_journald": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_compact_on_bootstrap": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_compact_on_start": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_compact_on_trim": "true", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_cpu_threads": "4", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_crush_min_required_version": "hammer", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_daemon_bytes": "419430400", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_data": "/var/lib/ceph/mon/ceph-0", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_data_avail_crit": "5", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_data_avail_warn": "30", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_data_size_warn": "16106127360", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_dump_json": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-osd.0.tdump", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_dump_transactions": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_extra_checks": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_no_require_squid": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-24T16:09:10.542 INFO:teuthology.orchestra.run.trial053.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_down_added_grace": "180", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_down_mkfs_grace": "60", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_down_uptime_grace": "60", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_election_default_strategy": "1", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_election_timeout": "5.000000", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_elector_ping_divisor": "2", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_enable_op_tracker": "true", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_fake_pool_delete": "false", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_force_quorum_join": "false", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_globalid_prealloc": "10000", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_health_detail_to_clog": "false", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_health_log_update_period": "5", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_health_max_detail": "50", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_health_to_clog": "true", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_health_to_clog_interval": "600", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_host": "10.20.193.53", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_host_override": "", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_initial_members": "", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-24T16:09:10.543 INFO:teuthology.orchestra.run.trial053.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_lease": "5.000000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_log_full_interval": "50", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_log_max": "10000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_log_max_summary": "50", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_max_log_epochs": "500", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_max_osd": "10000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_max_pg_per_osd": "10000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_max_pool_pg_num": "65536", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_mds_force_trim_to": "0", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_mds_skip_sanity": "false", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_memory_autotune": "true", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_memory_target": "2147483648", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_mgr_beacon_grace": "30", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_mgr_digest_period": "5", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_mgr_inactive_grace": "60", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_mgr_mkfs_grace": "120", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-24T16:09:10.544 INFO:teuthology.orchestra.run.trial053.stdout: "mon_min_osdmap_epochs": "500", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_netsplit_grace_period": "9", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_op_complaint_time": "30", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_op_history_duration": "600", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_op_history_size": "20", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_op_history_slow_op_size": "20", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_op_log_threshold": "5", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_auto_mark_in": "false", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_cache_size": "500", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_down_out_interval": "600", 2026-02-24T16:09:10.545 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_force_trim_to": "0", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_min_down_reporters": "2", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_report_timeout": "900", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_reporter_subtree_level": "host", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osdmap_full_prune_interval": "10", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osdmap_full_prune_min": "10000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_osdmap_full_prune_txsize": "100", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-24T16:09:10.546 INFO:teuthology.orchestra.run.trial053.stdout: "mon_pg_stuck_threshold": "60", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_probe_timeout": "2.000000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_reweight_max_change": "0.050000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_reweight_max_osds": "4", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_reweight_min_bytes_per_osd": "104857600", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_reweight_min_pgs_per_osd": "10", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_scrub_interval": "86400", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_scrub_max_keys": "100", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_scrub_timeout": "300", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_session_timeout": "300", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_smart_report_timeout": "5", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_stat_smooth_intervals": "6", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_stretch_pool_min_size": "2", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_stretch_pool_size": "4", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_sync_debug": "false", 2026-02-24T16:09:10.547 INFO:teuthology.orchestra.run.trial053.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_sync_provider_kill_at": "0", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_sync_requester_kill_at": "0", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_sync_timeout": "60.000000", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_target_pg_per_osd": "100", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_tick_interval": "5", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_timecheck_interval": "300.000000", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_use_min_delay_socket": "false", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_older_version_delay": "604800", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_filestore_osds": "true", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_insecure_global_id_reclaim": "true", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "true", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_misplaced": "false", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_older_version": "true", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_pool_no_redundancy": "false", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-24T16:09:10.548 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "monmap": "", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "motr_tracing_enabled": "false", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_op_threads": "3", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_cm": "false", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_device_name": "", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_dscp": "96", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_local_gid": "", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_port_num": "1", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_sl": "3", 2026-02-24T16:09:10.549 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_support_srq": "true", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_rdma_type": "ib", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_async_reap_threshold": "5", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_before_connect": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_ipv4": "true", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_ipv6": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_msgr1": "true", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_msgr2": "true", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_port_max": "7568", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_port_min": "6800", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_retry_count": "3", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_bind_retry_delay": "5", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_blackhole_client": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_blackhole_mds": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_blackhole_mgr": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_blackhole_mon": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_blackhole_osd": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_client_mode": "crc", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_cluster_mode": "crc", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_cluster_type": "", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_compress_secure": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_connection_idle_timeout": "900", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_connection_ready_timeout": "10", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_crc_data": "true", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_crc_header": "true", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_die_on_bad_msg": "false", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_die_on_bug": "true", 2026-02-24T16:09:10.550 INFO:teuthology.orchestra.run.trial053.stdout: "ms_die_on_old_message": "true", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_die_on_skipped_message": "false", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_coremask": "0xF", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_enable_tso": "true", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_hugepages": "", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_lro": "true", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_memory_channel": "4", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_pmd": "", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_port_id": "0", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_dump_on_send": "false", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_initial_backoff": "0.200000", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_inject_delay_max": "1.000000", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_inject_delay_type": "", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_inject_network_congestion": "0", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_inject_socket_failures": "0", 2026-02-24T16:09:10.551 INFO:teuthology.orchestra.run.trial053.stdout: "ms_learn_addr_from_peer": "true", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_max_accept_failures": "4", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_max_backoff": "15.000000", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_mon_client_mode": "crc", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_mon_cluster_mode": "crc", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_mon_service_mode": "crc", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_osd_compress_min_size": "1024", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_osd_compress_mode": "none", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_pq_min_cost": "65536", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_public_type": "", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_service_mode": "crc", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_tcp_listen_backlog": "512", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_tcp_nodelay": "true", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_tcp_rcvbuf": "0", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "ms_type": "async+posix", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "no_config_file": "false", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "objecter_completion_locks_per_session": "32", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "objecter_inflight_ops": "1024", 2026-02-24T16:09:10.552 INFO:teuthology.orchestra.run.trial053.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "objecter_tick_interval": "5.000000", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "objecter_timeout": "10.000000", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "objectstore_blackhole": "false", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "openssl_conf": "", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_agent_delay_time": "5.000000", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_agent_hist_halflife": "1000", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_agent_max_low_ops": "2", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_agent_max_ops": "4", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_agent_slop": "0.020000", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_asio_thread_count": "2", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_async_recovery_min_cost": "100", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_backfill_scan_max": "512", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_backfill_scan_min": "64", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_backoff_on_degraded": "false", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_backoff_on_peering": "false", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_backoff_on_unfound": "true", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_beacon_report_interval": "300", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_bench_duration": "30", 2026-02-24T16:09:10.553 INFO:teuthology.orchestra.run.trial053.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_bench_max_block_size": "67108864", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_blkin_trace_all": "false", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_check_for_log_corruption": "false", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_class_update_on_start": "true", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_client_message_cap": "256", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_client_message_size_cap": "524288000", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_client_op_priority": "63", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_client_watch_timeout": "30", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_command_max_records": "256", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_compact_on_start": "false", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_crush_chooseleaf_type": "0", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_crush_update_on_start": "true", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_crush_update_weight_set": "true", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_data": "/var/lib/ceph/osd/ceph-0", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-24T16:09:10.554 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_feed_pullee": "-1", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_misdirected_ops": "true", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_no_acting_change": "false", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_no_purge_strays": "false", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_op_order": "true", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_pg_log_writeout": "true", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_shutdown": "true", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_trim_objects": "true", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_verify_snaps": "false", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_debug_verify_stray_on_activate": "true", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_deep_scrub_keys": "1024", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-24T16:09:10.555 INFO:teuthology.orchestra.run.trial053.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_deep_scrub_update_digest_min_age": "30", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_default_data_pool_replay_window": "5", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_default_notify_timeout": "30", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_delete_sleep": "0.000000", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_discard_disconnected_ops": "true", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_ec_partial_reads": "true", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_enable_op_tracker": "true", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_fast_info": "true", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_fast_shutdown": "true", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_function_tracing": "false", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_heartbeat_grace": "20", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_heartbeat_interval": "6", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-24T16:09:10.556 INFO:teuthology.orchestra.run.trial053.stdout: "osd_heartbeat_min_peers": "10", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_heartbeat_min_size": "2000", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_heartbeat_stale": "600", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_hit_set_max_size": "100000", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_hit_set_min_size": "1000", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-0/journal", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_journal_size": "100", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_kill_backfill_at": "0", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_map_cache_size": "50", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_map_dedup": "true", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_map_message_max": "40", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_map_share_max_epochs": "40", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_attr_name_len": "100", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_attr_size": "0", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_backfills": "1", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_markdown_count": "5", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_markdown_period": "600", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_object_name_len": "2048", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_object_namespace_len": "256", 2026-02-24T16:09:10.557 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_object_size": "134217728", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_pg_blocked_by": "16", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_pg_log_entries": "10000", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_pgls": "1024", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_push_cost": "8388608", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_push_objects": "10", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_scrubs": "3", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_trimming_pgs": "2", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_write_op_reply_len": "64", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_max_write_size": "90", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_profile": "high_recovery_ops", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-24T16:09:10.558 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mclock_skip_benchmark": "true", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_memory_base": "805306368", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_memory_cache_min": "134217728", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_memory_target": "4294967296", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_memory_target_autotune": "false", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_min_pg_log_entries": "250", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_min_recovery_priority": "0", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mon_report_interval": "5", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_num_cache_shards": "32", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_num_op_tracker_shard": "32", 2026-02-24T16:09:10.559 INFO:teuthology.orchestra.run.trial053.stdout: "osd_numa_auto_affinity": "true", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_numa_node": "-1", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_numa_prefer_iface": "true", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_objecter_finishers": "1", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_objectstore": "seastore", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_objectstore_fuse": "false", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_objectstore_tracing": "false", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_complaint_time": "30.000000", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_history_duration": "600", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_history_size": "20", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_history_slow_op_size": "20", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_log_threshold": "5", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_num_shards": "0", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_num_shards_hdd": "1", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_num_shards_ssd": "8", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_pq_min_cost": "65536", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_queue_cut_off": "high", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_op_thread_timeout": "15", 2026-02-24T16:09:10.560 INFO:teuthology.orchestra.run.trial053.stdout: "osd_open_classes_on_start": "true", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_os_flags": "0", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_peering_op_priority": "255", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_delete_cost": "1048576", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_delete_priority": "5", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_log_trim_max": "10000", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_log_trim_min": "100", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_crimson": "false", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-24T16:09:10.561 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_flags": "0", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_min_size": "0", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_pg_num": "32", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_pgp_num": "0", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_read_ratio": "70", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_size": "2", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_default_type": "replicated", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_push_per_object_cost": "1000", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recover_clone_overlap": "true", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_cost": "20971520", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_max_active": "0", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_max_chunk": "1048576", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_max_single_start": "1", 2026-02-24T16:09:10.562 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_op_priority": "3", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_priority": "5", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_sleep": "0.000000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_requested_scrub_priority": "5", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_auto_repair": "false", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_begin_hour": "0", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_begin_week_day": "0", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_chunk_max": "15", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_chunk_min": "5", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_cost": "52428800", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_during_recovery": "false", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_end_hour": "0", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_end_week_day": "0", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_event_cost": "4096", 2026-02-24T16:09:10.563 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_invalid_stats": "true", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_load_threshold": "5.000000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_max_interval": "600.000000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_max_preemptions": "5", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_priority": "5", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_retry_delay": "30", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_retry_trimming": "10", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_scrub_sleep": "0.000000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_skip_data_digest": "false", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_smart_report_timeout": "5", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_snap_trim_cost": "1048576", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_snap_trim_priority": "5", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-24T16:09:10.564 INFO:teuthology.orchestra.run.trial053.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_target_transaction_size": "30", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_tracing": "false", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_use_stale_snap": "false", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "osdc_blkin_trace_all": "false", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_kill_at": "0", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_max_join_drift": "10", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_min": "500", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_min_wait": "0.050000", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_propose_interval": "1.000000", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_service_trim_max": "500", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_service_trim_min": "250", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_stash_full_interval": "25", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_trim_max": "500", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "paxos_trim_min": "250", 2026-02-24T16:09:10.565 INFO:teuthology.orchestra.run.trial053.stdout: "perf": "true", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "pid_file": "/var/run/ceph/ceph-osd.0.pid", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "pool_availability_update_interval": "1.000000", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "public_addr": "-", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "public_addrv": "", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "public_bind_addr": "-", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "public_network": "", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "public_network_interface": "", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "qat_compressor_busy_polling": "false", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "qat_compressor_enabled": "false", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "qat_compressor_session_max_number": "256", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rados_mon_op_timeout": "0", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rados_osd_op_timeout": "0", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rados_replica_read_policy": "default", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rados_tracing": "false", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_atime_update_interval": "60", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_balance_parent_reads": "false", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_balance_snap_reads": "false", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_blkin_trace_all": "false", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_cache": "true", 2026-02-24T16:09:10.566 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_cache_policy": "writearound", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_cache_size": "33554432", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_clone_copy_on_read": "false", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_compression_hint": "none", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_concurrent_management_ops": "10", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_clone_format": "auto", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_data_pool": "", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_features": "61", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_format": "2", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_map_options": "", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_order": "22", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_pool": "rbd", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_stripe_count": "0", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_default_stripe_unit": "0", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_enable_alloc_hint": "true", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_io_scheduler": "simple", 2026-02-24T16:09:10.567 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_order": "24", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_pool": "", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_journal_splay_width": "4", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_localize_parent_reads": "false", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_localize_snap_reads": "false", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-24T16:09:10.568 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_mtime_update_interval": "60", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_non_blocking_aio": "true", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_op_thread_timeout": "60", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_op_threads": "1", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_parent_cache_enabled": "false", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_plugins": "", 2026-02-24T16:09:10.569 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_bps_burst": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_bps_limit": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_exclude_ops": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_iops_burst": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_iops_limit": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_read_from_replica_policy": "default", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_skip_partial_discard": "true", 2026-02-24T16:09:10.570 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_tracing": "false", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_validate_names": "true", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rbd_validate_pool": "true", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "restapi_base_url": "", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "restapi_log_level": "", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_acl_grants_max_num": "100", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_admin_entry": "admin", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_asio_assert_yielding": "false", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_backend_store": "rados", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_barbican_url": "", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_beast_enable_async": "true", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_counters_cache": "false", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_eexist_override": "false", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-24T16:09:10.571 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_cache_enabled": "true", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_cache_expiry_interval": "900", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_cache_lru_size": "25000", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_config_store": "rados", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_content_length_compat": "false", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_copy_obj_progress": "true", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_cors_rules_max_num": "100", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_cross_domain_policy": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_kmip_addr": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_kmip_password": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_kmip_username": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_require_ssl": "true", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-24T16:09:10.572 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_addr": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_auth": "token", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_namespace": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_prefix": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_token_file": "", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_curl_buffersize": "524288", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_curl_low_speed_time": "300", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-24T16:09:10.573 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-0", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_data_log_changes_size": "1000", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_data_log_num_shards": "128", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_data_log_window": "30", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-24T16:09:10.574 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_disable_s3select": "false", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dns_name": "", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dns_s3website_name": "", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dynamic_resharding": "true", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_gc_threads": "true", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_lc_threads": "true", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_mdsearch": "true", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_ops_log": "false", 2026-02-24T16:09:10.575 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_quota_threads": "true", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_restore_threads": "true", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_static_website": "false", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enable_usage_log": "false", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_enforce_swift_acls": "true", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_exit_timeout_secs": "120", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_expose_bucket": "false", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_extended_http_attrs": "", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_filter": "none", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_frontends": "beast port=7480", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_gc_max_deferred": "50", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_gc_max_objs": "32", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_gc_processor_period": "3600", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_graceful_stop": "false", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-24T16:09:10.576 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_init_timeout": "300", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_kafka_connection_idle": "300", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_admin_domain": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_admin_password": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_admin_password_path": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_admin_project": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_admin_tenant": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_admin_user": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_barbican_domain": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_barbican_password": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_barbican_project": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_barbican_user": "", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-24T16:09:10.577 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_url": "", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lc_debug_interval": "-1", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lc_list_cnt": "1000", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lc_lock_max_time": "90", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lc_max_objs": "32", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lc_max_rules": "1000", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lc_max_worker": "3", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lc_thread_delay": "0", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ldap_dnattr": "uid", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ldap_searchfilter": "", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ldap_uri": "", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_log_http_headers": "", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_log_object_name_utc": "false", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lua_enable": "true", 2026-02-24T16:09:10.578 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/osd.0", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_attr_name_len": "0", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_attr_size": "0", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_chunk_size": "4194304", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_control_aio": "8", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_listing_results": "5000", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_notify_retries": "10", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_put_param_size": "1048576", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_put_size": "5368709120", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_max_slo_entries": "1000", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_md_log_max_shards": "64", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_mp_lock_max_time": "600", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-24T16:09:10.579 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_max_gc": "300", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_num_async_rados_threads": "32", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_num_control_oids": "8", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_numa_node": "-1", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_objexp_chunk_size": "100", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_objexp_gc_interval": "600", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_op_thread_timeout": "600", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_op_tracing": "false", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_opa_token": "", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_opa_url": "", 2026-02-24T16:09:10.580 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_opa_verify_ssl": "true", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-osd.0.log", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ops_log_rados": "false", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ops_log_socket_path": "", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_period_push_interval": "2.000000", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_posix_cache_lanes": "3", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_posix_cache_partitions": "3", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_print_continue": "true", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_rados_tracing": "false", 2026-02-24T16:09:10.581 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_ratelimit_interval": "60", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_realm": "", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_realm_id": "", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_region": "", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_request_uri": "", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_reshard_batch_size": "64", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_reshard_max_aio": "128", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_reshard_num_logs": "16", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_reshard_thread_interval": "600", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_resolve_cname": "false", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_restore_debug_interval": "-1", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_restore_lock_max_time": "90", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_restore_max_objs": "32", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_restore_processor_period": "900", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_run_sync_thread": "true", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-24T16:09:10.582 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_scheduler_type": "throttler", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_script_uri": "", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_service_provider_name": "", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sts_client_id": "", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sts_client_secret": "", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sts_entry": "sts", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sts_key": "", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sts_min_session_duration": "900", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sts_token_introspection_url": "", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_account_in_url": "false", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_auth_entry": "auth", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_auth_url": "", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_custom_header": "", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_need_stats": "true", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_tenant_name": "", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_token_expiration": "86400", 2026-02-24T16:09:10.583 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_url": "", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_url_prefix": "swift", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_lease_period": "120", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_thread_pool_size": "512", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_torrent_comment": "", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_torrent_createby": "", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_torrent_encoding": "", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_torrent_flag": "false", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_torrent_origin": "", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_torrent_tracker": "", 2026-02-24T16:09:10.584 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_trust_forwarded_https": "false", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_usage_log_key_transition": "true", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_usage_max_shards": "32", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_usage_max_user_shards": "1", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_use_opa_authz": "false", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_counters_cache": "false", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_max_buckets": "1000", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_policies_max_num": "100", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_user_unique_email": "true", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_verify_ssl": "true", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_zone": "", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_zone_id": "", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_zonegroup": "", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_zonegroup_id": "", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgwlc_auto_session_clear": "true", 2026-02-24T16:09:10.585 INFO:teuthology.orchestra.run.trial053.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_block_size": "4096", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_cache_size": "536870912", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_index_type": "binary_search", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_partition_filters": "false", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_perf": "false", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "run_dir": "/var/run/ceph", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_block_create": "true", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-24T16:09:10.586 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_cachepin_size_pershard": "67108864", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_cachepin_type": "LRU", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_cold_tier_generations": "3", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_default_max_object_size": "16777216", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_device_size": "53687091200", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_full_integrity_check": "false", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_hot_tier_generations": "5", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_journal_batch_capacity": "16", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_main_device_type": "SSD", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_max_concurrent_transactions": "8", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_max_data_allocation_size": "0", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_require_partition_count_match_reactor_count": "true", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "seastore_segment_size": "67108864", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "service_unique_id": "", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "set_keepcaps": "false", 2026-02-24T16:09:10.587 INFO:teuthology.orchestra.run.trial053.stdout: "setgroup": "", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "setuser": "", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "setuser_match_path": "", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "subv_metrics_window_interval": "30", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "thp": "false", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "threadpool_default_timeout": "60", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "throttler_perf_counter": "true", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "tmp_dir": "/tmp", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "tmp_file_template": "/tmp/ceph-osd.0.XXXXXX", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "uadk_compressor_enabled": "false", 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-24T16:09:10.588 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:09:10.589 INFO:tasks.ceph_objectstore_tool:seastore_main_device_type is SSD... 2026-02-24T16:09:10.590 INFO:tasks.ceph_objectstore_tool:pgnum: 8 2026-02-24T16:09:10.590 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph osd pool create rep_pool 8 8 --cluster ceph 2026-02-24T16:09:10.663 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:10.657+0000 7f2f8a03d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:10.666 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:10.665+0000 7f2f8a03d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:11.415 INFO:teuthology.orchestra.run.trial053.stderr:pool 'rep_pool' created 2026-02-24T16:09:11.432 INFO:tasks.ceph_objectstore_tool:objects: 5 2026-02-24T16:09:11.432 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T16:09:11.512 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:11.509+0000 7f34478cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:11.514 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:11.513+0000 7f34478cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:11.626 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:09:11.626 INFO:teuthology.orchestra.run.trial053.stdout:{"epoch":20,"fsid":"6abeadec-6aab-4afb-8494-572099c2e04c","created":"2026-02-24T16:08:46.808406+0000","modified":"2026-02-24T16:09:11.414003+0000","last_up_change":"2026-02-24T16:09:00.377334+0000","last_in_change":"2026-02-24T16:08:48.763462+0000","flags":"nodown,noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800128,"flags_set":["nodown","noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T16:09:01.060550+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T16:09:03.115624+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"rep_pool","create_time":"2026-02-24T16:09:10.778838+0000","flags":294913,"flags_names":"hashpspool,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba280e4-1777-43ce-8051-4b7a6cefe599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6806","nonce":360737695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6807","nonce":360737695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6815","nonce":360737695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6816","nonce":360737695}]},"public_addr":"10.20.193.53:6806/360737695","cluster_addr":"10.20.193.53:6807/360737695","heartbeat_back_addr":"10.20.193.53:6815/360737695","heartbeat_front_addr":"10.20.193.53:6816/360737695","state":["exists","up"]},{"osd":1,"uuid":"1b6eb159-3f62-4730-8d91-940c1dd852dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6802","nonce":821453193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6805","nonce":821453193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6810","nonce":821453193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6811","nonce":821453193}]},"public_addr":"10.20.193.53:6802/821453193","cluster_addr":"10.20.193.53:6805/821453193","heartbeat_back_addr":"10.20.193.53:6810/821453193","heartbeat_front_addr":"10.20.193.53:6811/821453193","state":["exists","up"]},{"osd":2,"uuid":"f00a93d9-2c45-428b-98de-89b05ea2ee94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6813","nonce":1170288352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6812","nonce":1170288352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6820","nonce":1170288352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6819","nonce":1170288352}]},"public_addr":"10.20.193.53:6813/1170288352","cluster_addr":"10.20.193.53:6812/1170288352","heartbeat_back_addr":"10.20.193.53:6820/1170288352","heartbeat_front_addr":"10.20.193.53:6819/1170288352","state":["exists","up"]},{"osd":3,"uuid":"5526503d-de9b-4bf8-b9a0-a31f664936c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6804","nonce":3103081419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6803","nonce":3103081419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6809","nonce":3103081419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6808","nonce":3103081419}]},"public_addr":"10.20.193.53:6804/3103081419","cluster_addr":"10.20.193.53:6803/3103081419","heartbeat_back_addr":"10.20.193.53:6809/3103081419","heartbeat_front_addr":"10.20.193.53:6808/3103081419","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T16:09:11.635 DEBUG:tasks.ceph_objectstore_tool:repid=3 2026-02-24T16:09:11.642 DEBUG:teuthology.orchestra.run.trial053:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-24T16:09:11.659 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:09:11.659 DEBUG:teuthology.orchestra.run.trial053:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-24T16:09:11.716 DEBUG:teuthology.orchestra.run.trial053:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-24T16:09:11.775 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:09:11.775 DEBUG:teuthology.orchestra.run.trial053:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-24T16:09:11.832 DEBUG:teuthology.orchestra.run.trial053:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-24T16:09:11.891 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:09:11.891 DEBUG:teuthology.orchestra.run.trial053:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-24T16:09:11.949 DEBUG:teuthology.orchestra.run.trial053:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-24T16:09:12.007 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:09:12.008 DEBUG:teuthology.orchestra.run.trial053:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-24T16:09:12.064 DEBUG:teuthology.orchestra.run.trial053:> rm -f /home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-24T16:09:12.122 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:09:12.123 DEBUG:teuthology.orchestra.run.trial053:> dd of=/home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-24T16:09:12.179 INFO:tasks.ceph_objectstore_tool:Creating 5 objects in pool 2026-02-24T16:09:12.180 INFO:tasks.util.rados:rados -p rep_pool put REPobject1 /home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-24T16:09:12.180 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject1 /home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-24T16:09:12.257 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.256+0000 7f0191660ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.261 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.260+0000 7f0191660ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.261 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.260+0000 7f0191660ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.518 INFO:tasks.util.rados:rados -p rep_pool put REPobject2 /home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-24T16:09:12.519 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject2 /home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-24T16:09:12.597 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.596+0000 7f7ba4eccec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.600 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.599+0000 7f7ba4eccec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.600 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.599+0000 7f7ba4eccec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.622 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject2 key2-1 val2-1 2026-02-24T16:09:12.699 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.697+0000 7f931fc91ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.702 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.701+0000 7f931fc91ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.702 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.701+0000 7f931fc91ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.723 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapheader REPobject2 hdr2 2026-02-24T16:09:12.799 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.798+0000 7f42cc233ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.802 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.801+0000 7f42cc233ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.802 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.801+0000 7f42cc233ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.820 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject2 okey2-1 oval2-1 2026-02-24T16:09:12.898 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.896+0000 7f643cac6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.901 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.899+0000 7f643cac6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.901 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.899+0000 7f643cac6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:12.919 INFO:tasks.util.rados:rados -p rep_pool put REPobject3 /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-24T16:09:12.919 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject3 /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-24T16:09:12.997 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.996+0000 7f2dbe291ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.001 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:12.999+0000 7f2dbe291ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.001 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.000+0000 7f2dbe291ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.022 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject3 key3-1 val3-1 2026-02-24T16:09:13.098 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.097+0000 7f4864e31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.101 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.100+0000 7f4864e31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.102 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.101+0000 7f4864e31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.120 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject3 key3-2 val3-2 2026-02-24T16:09:13.195 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.194+0000 7f5a78c2eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.199 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.197+0000 7f5a78c2eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.199 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.197+0000 7f5a78c2eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.216 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapheader REPobject3 hdr3 2026-02-24T16:09:13.292 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.291+0000 7f4b73aa2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.295 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.294+0000 7f4b73aa2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.295 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.294+0000 7f4b73aa2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.313 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject3 okey3-1 oval3-1 2026-02-24T16:09:13.389 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.387+0000 7f925f09dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.392 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.390+0000 7f925f09dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.392 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.390+0000 7f925f09dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.409 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject3 okey3-2 oval3-2 2026-02-24T16:09:13.486 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.483+0000 7f0bab434ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.489 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.487+0000 7f0bab434ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.489 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.487+0000 7f0bab434ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.508 INFO:tasks.util.rados:rados -p rep_pool put REPobject4 /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-24T16:09:13.508 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject4 /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-24T16:09:13.587 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.584+0000 7f27e2a33ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.590 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.588+0000 7f27e2a33ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.590 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.588+0000 7f27e2a33ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.612 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject4 key4-1 val4-1 2026-02-24T16:09:13.689 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.687+0000 7f9704833ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.693 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.690+0000 7f9704833ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.693 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.690+0000 7f9704833ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.712 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject4 key4-2 val4-2 2026-02-24T16:09:13.787 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.785+0000 7feed5fc6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.791 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.788+0000 7feed5fc6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.791 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.789+0000 7feed5fc6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.809 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject4 key4-3 val4-3 2026-02-24T16:09:13.886 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.884+0000 7f8ded299ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.889 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.887+0000 7f8ded299ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.889 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.887+0000 7f8ded299ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.907 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapheader REPobject4 hdr4 2026-02-24T16:09:13.983 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.981+0000 7fef00694ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.987 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.985+0000 7fef00694ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:13.987 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:13.985+0000 7fef00694ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.006 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject4 okey4-1 oval4-1 2026-02-24T16:09:14.083 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.081+0000 7f5191281ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.086 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.084+0000 7f5191281ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.087 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.084+0000 7f5191281ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.104 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject4 okey4-2 oval4-2 2026-02-24T16:09:14.180 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.178+0000 7f5b042c0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.184 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.181+0000 7f5b042c0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.184 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.181+0000 7f5b042c0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.201 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject4 okey4-3 oval4-3 2026-02-24T16:09:14.277 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.275+0000 7f962e483ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.280 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.278+0000 7f962e483ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.281 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.278+0000 7f962e483ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.301 INFO:tasks.util.rados:rados -p rep_pool put REPobject5 /home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-24T16:09:14.301 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool put REPobject5 /home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-24T16:09:14.379 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.377+0000 7f6881ec2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.382 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.380+0000 7f6881ec2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.382 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.380+0000 7f6881ec2ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.408 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject5 key5-1 val5-1 2026-02-24T16:09:14.484 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.481+0000 7fe9b7c8eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.487 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.485+0000 7fe9b7c8eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.487 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.485+0000 7fe9b7c8eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.505 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject5 key5-2 val5-2 2026-02-24T16:09:14.582 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.580+0000 7f8711a31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.585 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.583+0000 7f8711a31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.585 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.583+0000 7f8711a31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.603 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject5 key5-3 val5-3 2026-02-24T16:09:14.681 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.679+0000 7f26aa2a6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.684 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.682+0000 7f26aa2a6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.684 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.682+0000 7f26aa2a6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.703 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setxattr REPobject5 key5-4 val5-4 2026-02-24T16:09:14.779 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.776+0000 7f00af6d8ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.782 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.780+0000 7f00af6d8ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.782 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.780+0000 7f00af6d8ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.800 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapheader REPobject5 hdr5 2026-02-24T16:09:14.876 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.874+0000 7fe4df632ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.879 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.877+0000 7fe4df632ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.879 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.877+0000 7fe4df632ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.898 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject5 okey5-1 oval5-1 2026-02-24T16:09:14.974 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.972+0000 7f04b98a6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.978 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.975+0000 7f04b98a6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.978 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:14.975+0000 7f04b98a6ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:14.997 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject5 okey5-2 oval5-2 2026-02-24T16:09:15.072 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.070+0000 7fa81d031ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.075 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.073+0000 7fa81d031ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.076 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.073+0000 7fa81d031ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.094 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject5 okey5-3 oval5-3 2026-02-24T16:09:15.171 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.169+0000 7f59fe230ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.174 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.172+0000 7f59fe230ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.175 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.172+0000 7f59fe230ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.194 DEBUG:teuthology.orchestra.run.trial053:> rados -p rep_pool setomapval REPobject5 okey5-4 oval5-4 2026-02-24T16:09:15.270 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.268+0000 7fd6efa3fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.273 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.272+0000 7fd6efa3fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.273 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.272+0000 7fd6efa3fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.293 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T16:09:15.409 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.405+0000 7f4082bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.412 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.410+0000 7f4082bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.521 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:09:15.522 INFO:teuthology.orchestra.run.trial053.stderr:dumped all 2026-02-24T16:09:15.531 INFO:teuthology.orchestra.run.trial053.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2026-02-24T16:09:15.048617+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":910387,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":87,"num_write_kb":1423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60,"ondisk_log_size":60,"up":22,"acting":22,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":3140,"kb_used_data":3140,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209187772,"statfs":{"total":214211493888,"available":214208278528,"internally_reserved":0,"allocated":3215360,"data_stored":3215360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.634380"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":90,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-24T16:09:09.425090+0000","last_change":"2026-02-24T16:09:02.427010+0000","last_active":"2026-02-24T16:09:09.425090+0000","last_peered":"2026-02-24T16:09:09.425090+0000","last_clean":"2026-02-24T16:09:09.425090+0000","last_became_active":"2026-02-24T16:09:02.417583+0000","last_became_peered":"2026-02-24T16:09:02.417583+0000","last_unstale":"2026-02-24T16:09:09.425090+0000","last_undegraded":"2026-02-24T16:09:09.425090+0000","last_fullsized":"2026-02-24T16:09:09.425090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_clean_scrub_stamp":"2026-02-24T16:09:01.383612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-24T16:09:13.434770+0000","last_change":"2026-02-24T16:09:06.419216+0000","last_active":"2026-02-24T16:09:13.434770+0000","last_peered":"2026-02-24T16:09:13.434770+0000","last_clean":"2026-02-24T16:09:13.434770+0000","last_became_active":"2026-02-24T16:09:04.441976+0000","last_became_peered":"2026-02-24T16:09:04.441976+0000","last_unstale":"2026-02-24T16:09:13.434770+0000","last_undegraded":"2026-02-24T16:09:13.434770+0000","last_fullsized":"2026-02-24T16:09:13.434770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'5","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-24T16:09:13.433827+0000","last_change":"2026-02-24T16:09:12.507522+0000","last_active":"2026-02-24T16:09:13.433827+0000","last_peered":"2026-02-24T16:09:13.433827+0000","last_clean":"2026-02-24T16:09:13.433827+0000","last_became_active":"2026-02-24T16:09:12.501129+0000","last_became_peered":"2026-02-24T16:09:12.501129+0000","last_unstale":"2026-02-24T16:09:13.433827+0000","last_undegraded":"2026-02-24T16:09:13.433827+0000","last_fullsized":"2026-02-24T16:09:13.433827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-24T16:09:13.434263+0000","last_change":"2026-02-24T16:09:06.419150+0000","last_active":"2026-02-24T16:09:13.434263+0000","last_peered":"2026-02-24T16:09:13.434263+0000","last_clean":"2026-02-24T16:09:13.434263+0000","last_became_active":"2026-02-24T16:09:04.433486+0000","last_became_peered":"2026-02-24T16:09:04.433486+0000","last_unstale":"2026-02-24T16:09:13.434263+0000","last_undegraded":"2026-02-24T16:09:13.434263+0000","last_fullsized":"2026-02-24T16:09:13.434263+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T16:09:11.414003+0000","last_change":"2026-02-24T16:09:11.414003+0000","last_active":"2026-02-24T16:09:11.414003+0000","last_peered":"2026-02-24T16:09:11.414003+0000","last_clean":"2026-02-24T16:09:11.414003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T16:09:11.414003+0000","last_undegraded":"2026-02-24T16:09:11.414003+0000","last_fullsized":"2026-02-24T16:09:11.414003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-24T16:09:09.422012+0000","last_change":"2026-02-24T16:09:06.416648+0000","last_active":"2026-02-24T16:09:09.422012+0000","last_peered":"2026-02-24T16:09:09.422012+0000","last_clean":"2026-02-24T16:09:09.422012+0000","last_became_active":"2026-02-24T16:09:04.446518+0000","last_became_peered":"2026-02-24T16:09:04.446518+0000","last_unstale":"2026-02-24T16:09:09.422012+0000","last_undegraded":"2026-02-24T16:09:09.422012+0000","last_fullsized":"2026-02-24T16:09:09.422012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T16:09:11.414003+0000","last_change":"2026-02-24T16:09:11.414003+0000","last_active":"2026-02-24T16:09:11.414003+0000","last_peered":"2026-02-24T16:09:11.414003+0000","last_clean":"2026-02-24T16:09:11.414003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T16:09:11.414003+0000","last_undegraded":"2026-02-24T16:09:11.414003+0000","last_fullsized":"2026-02-24T16:09:11.414003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-24T16:09:13.437273+0000","last_change":"2026-02-24T16:09:06.421807+0000","last_active":"2026-02-24T16:09:13.437273+0000","last_peered":"2026-02-24T16:09:13.437273+0000","last_clean":"2026-02-24T16:09:13.437273+0000","last_became_active":"2026-02-24T16:09:04.437708+0000","last_became_peered":"2026-02-24T16:09:04.437708+0000","last_unstale":"2026-02-24T16:09:13.437273+0000","last_undegraded":"2026-02-24T16:09:13.437273+0000","last_fullsized":"2026-02-24T16:09:13.437273+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T16:09:11.414003+0000","last_change":"2026-02-24T16:09:11.414003+0000","last_active":"2026-02-24T16:09:11.414003+0000","last_peered":"2026-02-24T16:09:11.414003+0000","last_clean":"2026-02-24T16:09:11.414003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T16:09:11.414003+0000","last_undegraded":"2026-02-24T16:09:11.414003+0000","last_fullsized":"2026-02-24T16:09:11.414003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T16:09:11.414003+0000","last_change":"2026-02-24T16:09:11.414003+0000","last_active":"2026-02-24T16:09:11.414003+0000","last_peered":"2026-02-24T16:09:11.414003+0000","last_clean":"2026-02-24T16:09:11.414003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T16:09:11.414003+0000","last_undegraded":"2026-02-24T16:09:11.414003+0000","last_fullsized":"2026-02-24T16:09:11.414003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-24T16:09:09.427019+0000","last_change":"2026-02-24T16:09:06.418542+0000","last_active":"2026-02-24T16:09:09.427019+0000","last_peered":"2026-02-24T16:09:09.427019+0000","last_clean":"2026-02-24T16:09:09.427019+0000","last_became_active":"2026-02-24T16:09:04.446265+0000","last_became_peered":"2026-02-24T16:09:04.446265+0000","last_unstale":"2026-02-24T16:09:09.427019+0000","last_undegraded":"2026-02-24T16:09:09.427019+0000","last_fullsized":"2026-02-24T16:09:09.427019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T16:09:11.414003+0000","last_change":"2026-02-24T16:09:11.414003+0000","last_active":"2026-02-24T16:09:11.414003+0000","last_peered":"2026-02-24T16:09:11.414003+0000","last_clean":"2026-02-24T16:09:11.414003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T16:09:11.414003+0000","last_undegraded":"2026-02-24T16:09:11.414003+0000","last_fullsized":"2026-02-24T16:09:11.414003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-24T16:09:13.436528+0000","last_change":"2026-02-24T16:09:06.421528+0000","last_active":"2026-02-24T16:09:13.436528+0000","last_peered":"2026-02-24T16:09:13.436528+0000","last_clean":"2026-02-24T16:09:13.436528+0000","last_became_active":"2026-02-24T16:09:04.444473+0000","last_became_peered":"2026-02-24T16:09:04.444473+0000","last_unstale":"2026-02-24T16:09:13.436528+0000","last_undegraded":"2026-02-24T16:09:13.436528+0000","last_fullsized":"2026-02-24T16:09:13.436528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-24T16:09:13.436002+0000","last_change":"2026-02-24T16:09:12.473911+0000","last_active":"2026-02-24T16:09:13.436002+0000","last_peered":"2026-02-24T16:09:13.436002+0000","last_clean":"2026-02-24T16:09:13.436002+0000","last_became_active":"2026-02-24T16:09:12.468367+0000","last_became_peered":"2026-02-24T16:09:12.468367+0000","last_unstale":"2026-02-24T16:09:13.436002+0000","last_undegraded":"2026-02-24T16:09:13.436002+0000","last_fullsized":"2026-02-24T16:09:13.436002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-24T16:09:09.426632+0000","last_change":"2026-02-24T16:09:06.417281+0000","last_active":"2026-02-24T16:09:09.426632+0000","last_peered":"2026-02-24T16:09:09.426632+0000","last_clean":"2026-02-24T16:09:09.426632+0000","last_became_active":"2026-02-24T16:09:04.433623+0000","last_became_peered":"2026-02-24T16:09:04.433623+0000","last_unstale":"2026-02-24T16:09:09.426632+0000","last_undegraded":"2026-02-24T16:09:09.426632+0000","last_fullsized":"2026-02-24T16:09:09.426632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-24T16:09:11.414003+0000","last_change":"2026-02-24T16:09:11.414003+0000","last_active":"2026-02-24T16:09:11.414003+0000","last_peered":"2026-02-24T16:09:11.414003+0000","last_clean":"2026-02-24T16:09:11.414003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-24T16:09:11.414003+0000","last_undegraded":"2026-02-24T16:09:11.414003+0000","last_fullsized":"2026-02-24T16:09:11.414003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-24T16:09:13.436679+0000","last_change":"2026-02-24T16:09:06.419766+0000","last_active":"2026-02-24T16:09:13.436679+0000","last_peered":"2026-02-24T16:09:13.436679+0000","last_clean":"2026-02-24T16:09:13.436679+0000","last_became_active":"2026-02-24T16:09:04.464847+0000","last_became_peered":"2026-02-24T16:09:04.464847+0000","last_unstale":"2026-02-24T16:09:13.436679+0000","last_undegraded":"2026-02-24T16:09:13.436679+0000","last_fullsized":"2026-02-24T16:09:13.436679+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551960064,"internally_reserved":0,"allocated":913408,"data_stored":913408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":4,"acting":4,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160656338944,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53551788032,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":820,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296908,"statfs":{"total":53552873472,"available":53552033792,"internally_reserved":0,"allocated":839680,"data_stored":839680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640265,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":268,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52297460,"statfs":{"total":53552873472,"available":53552599040,"internally_reserved":0,"allocated":274432,"data_stored":274432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640265,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1028,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296700,"statfs":{"total":53552873472,"available":53551820800,"internally_reserved":0,"allocated":1052672,"data_stored":1052672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640266,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1024,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296704,"statfs":{"total":53552873472,"available":53551824896,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53551788032,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53551788032,"internally_reserved":0,"allocated":1085440,"data_stored":1085440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53552590848,"internally_reserved":0,"allocated":282624,"data_stored":282624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551960064,"internally_reserved":0,"allocated":913408,"data_stored":913408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551960064,"internally_reserved":0,"allocated":913408,"data_stored":913408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T16:09:15.533 INFO:tasks.ceph_objectstore_tool:Expected pgs: {3: ['3.2', '3.7'], 2: ['3.2'], 1: ['3.7']} 2026-02-24T16:09:15.533 INFO:tasks.ceph_objectstore_tool:Expected : {'REPobject1': {'xattr': {}, 'omap': {}}, 'REPobject2': {'xattr': {'key2-1': 'val2-1'}, 'omapheader': 'hdr2', 'omap': {'okey2-1': 'oval2-1'}}, 'REPobject3': {'xattr': {'key3-1': 'val3-1', 'key3-2': 'val3-2'}, 'omapheader': 'hdr3', 'omap': {'okey3-1': 'oval3-1', 'okey3-2': 'oval3-2'}}, 'REPobject4': {'xattr': {'key4-1': 'val4-1', 'key4-2': 'val4-2', 'key4-3': 'val4-3'}, 'omapheader': 'hdr4', 'omap': {'okey4-1': 'oval4-1', 'okey4-2': 'oval4-2', 'okey4-3': 'oval4-3'}}, 'REPobject5': {'xattr': {'key5-1': 'val5-1', 'key5-2': 'val5-2', 'key5-3': 'val5-3', 'key5-4': 'val5-4'}, 'omapheader': 'hdr5', 'omap': {'okey5-1': 'oval5-1', 'okey5-2': 'oval5-2', 'okey5-3': 'oval5-3', 'okey5-4': 'oval5-4'}}} 2026-02-24T16:09:15.533 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-24T16:09:15.609 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.605+0000 7f56b9962640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.611 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:09:15.609+0000 7f56b9962640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:09:15.723 INFO:teuthology.orchestra.run.trial053.stdout:epoch 22 2026-02-24T16:09:15.723 INFO:teuthology.orchestra.run.trial053.stdout:fsid 6abeadec-6aab-4afb-8494-572099c2e04c 2026-02-24T16:09:15.723 INFO:teuthology.orchestra.run.trial053.stdout:created 2026-02-24T16:08:46.808406+0000 2026-02-24T16:09:15.723 INFO:teuthology.orchestra.run.trial053.stdout:modified 2026-02-24T16:09:13.422070+0000 2026-02-24T16:09:15.723 INFO:teuthology.orchestra.run.trial053.stdout:flags nodown,noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T16:09:15.723 INFO:teuthology.orchestra.run.trial053.stdout:crush_version 5 2026-02-24T16:09:15.723 INFO:teuthology.orchestra.run.trial053.stdout:full_ratio 0.95 2026-02-24T16:09:15.723 INFO:teuthology.orchestra.run.trial053.stdout:backfillfull_ratio 0.9 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:nearfull_ratio 0.85 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:require_min_compat_client luminous 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:min_compat_client jewel 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:require_osd_release tentacle 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:stretch_mode_enabled false 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:allow_crimson=true 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout: removed_snaps_queue [2~1] 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:pool 3 'rep_pool' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,crimson stripe_width 0 read_balance_score 1.50 2026-02-24T16:09:15.724 INFO:teuthology.orchestra.run.trial053.stdout:max_osd 4 2026-02-24T16:09:15.725 INFO:teuthology.orchestra.run.trial053.stdout:osd.0 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599 2026-02-24T16:09:15.725 INFO:teuthology.orchestra.run.trial053.stdout:osd.1 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd 2026-02-24T16:09:15.725 INFO:teuthology.orchestra.run.trial053.stdout:osd.2 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94 2026-02-24T16:09:15.725 INFO:teuthology.orchestra.run.trial053.stdout:osd.3 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9 2026-02-24T16:09:15.732 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599', 'osd.1 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd', 'osd.2 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94', 'osd.3 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9'] 2026-02-24T16:09:15.733 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-24T16:09:15.733 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:09:15.785 INFO:tasks.ceph.osd.0:Stopped 2026-02-24T16:09:15.786 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-24T16:09:15.786 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:09:15.842 INFO:tasks.ceph.osd.1:Stopped 2026-02-24T16:09:15.843 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-24T16:09:15.843 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:09:15.897 INFO:tasks.ceph.osd.2:Stopped 2026-02-24T16:09:15.897 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-24T16:09:15.897 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:09:15.951 INFO:tasks.ceph.osd.3:Stopped 2026-02-24T16:09:20.952 INFO:tasks.ceph_objectstore_tool:Test --op list by generating json for all objects 2026-02-24T16:09:20.953 DEBUG:tasks.ceph_objectstore_tool:ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:09:20.953 DEBUG:tasks.ceph_objectstore_tool:['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-24T16:09:20.953 INFO:tasks.ceph_objectstore_tool:process osd.0 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:09:20.953 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-0 --device-type SSD --op list 2026-02-24T16:09:21.099 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:21,098 seastar - Reactor backend: linux-aio 2026-02-24T16:09:21.107 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:21,106 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:21.107 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:21,106 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:21.110 INFO:teuthology.orchestra.run.trial053.stderr:==44333==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:21.907 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.908 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.909 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.910 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.911 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.911 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.920 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.920 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.920 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.920 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.920 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["1.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["1.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["1.0",{"oid":"main.db-journal.0000000000000000","key":"","snapid":-2,"hash":1969844440,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["1.0",{"oid":"main.db.0000000000000000","key":"","snapid":-2,"hash":1315310604,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["2.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["2.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["3.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["3.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:21.921 INFO:teuthology.orchestra.run.trial053.stdout:["2.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["2.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["3.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["3.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["2.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["2.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["2.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["2.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["3.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["3.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:21.922 INFO:teuthology.orchestra.run.trial053.stdout:["3.6",{"oid":"REPobject4","key":"","snapid":-2,"hash":833930126,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:23.447 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:23.447 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:23.447 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:23.447 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:23.447 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:23.447 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:23.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.486 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.487 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:23.488 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"main.db-journal.0000000000000000","key":"","snapid":-2,"hash":1969844440,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"main.db.0000000000000000","key":"","snapid":-2,"hash":1315310604,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["2.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["2.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["3.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["3.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["2.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["2.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["3.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["3.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["2.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:23.489 INFO:tasks.ceph_objectstore_tool:parsing ["2.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:23.490 INFO:tasks.ceph_objectstore_tool:parsing ["2.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:23.490 INFO:tasks.ceph_objectstore_tool:parsing ["2.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:23.490 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:23.490 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:23.490 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"REPobject4","key":"","snapid":-2,"hash":833930126,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:23.490 INFO:tasks.ceph_objectstore_tool:found REPobject4 2026-02-24T16:09:23.490 INFO:tasks.ceph_objectstore_tool:process osd.1 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:09:23.490 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --op list 2026-02-24T16:09:23.632 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:23,631 seastar - Reactor backend: linux-aio 2026-02-24T16:09:23.640 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:23,639 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:23.641 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:23,639 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:23.643 INFO:teuthology.orchestra.run.trial053.stderr:==44364==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:24.378 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.379 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.380 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.381 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.382 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.395 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.396 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.396 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.396 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.396 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.396 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.396 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.397 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:24.397 INFO:teuthology.orchestra.run.trial053.stdout:["1.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-24T16:09:24.397 INFO:teuthology.orchestra.run.trial053.stdout:["1.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:24.397 INFO:teuthology.orchestra.run.trial053.stdout:["1.0",{"oid":"main.db-journal.0000000000000000","key":"","snapid":-2,"hash":1969844440,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-24T16:09:24.397 INFO:teuthology.orchestra.run.trial053.stdout:["1.0",{"oid":"main.db.0000000000000000","key":"","snapid":-2,"hash":1315310604,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-24T16:09:24.398 INFO:teuthology.orchestra.run.trial053.stdout:["2.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:24.398 INFO:teuthology.orchestra.run.trial053.stdout:["2.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:24.398 INFO:teuthology.orchestra.run.trial053.stdout:["3.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:24.398 INFO:teuthology.orchestra.run.trial053.stdout:["3.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:24.398 INFO:teuthology.orchestra.run.trial053.stdout:["3.4",{"oid":"REPobject1","key":"","snapid":-2,"hash":623868980,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:24.398 INFO:teuthology.orchestra.run.trial053.stdout:["3.4",{"oid":"REPobject2","key":"","snapid":-2,"hash":3521648588,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:24.398 INFO:teuthology.orchestra.run.trial053.stdout:["2.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:24.398 INFO:teuthology.orchestra.run.trial053.stdout:["2.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:24.399 INFO:teuthology.orchestra.run.trial053.stdout:["2.2",{"oid":"rbd_info","key":"","snapid":-2,"hash":2886620986,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:24.399 INFO:teuthology.orchestra.run.trial053.stdout:["2.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:24.399 INFO:teuthology.orchestra.run.trial053.stdout:["2.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:24.399 INFO:teuthology.orchestra.run.trial053.stdout:["3.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:24.399 INFO:teuthology.orchestra.run.trial053.stdout:["3.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:24.399 INFO:teuthology.orchestra.run.trial053.stdout:["2.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:24.399 INFO:teuthology.orchestra.run.trial053.stdout:["2.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:24.399 INFO:teuthology.orchestra.run.trial053.stdout:["3.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:24.399 INFO:teuthology.orchestra.run.trial053.stdout:["3.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:24.400 INFO:teuthology.orchestra.run.trial053.stdout:["3.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:24.400 INFO:teuthology.orchestra.run.trial053.stdout:["3.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:24.400 INFO:teuthology.orchestra.run.trial053.stdout:["3.6",{"oid":"REPobject4","key":"","snapid":-2,"hash":833930126,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:25.935 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:25.936 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:25.936 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:25.936 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:25.936 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:25.936 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:25.973 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.973 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.973 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.973 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.973 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.973 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.973 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.973 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.974 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":1,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"main.db-journal.0000000000000000","key":"","snapid":-2,"hash":1969844440,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["1.0",{"oid":"main.db.0000000000000000","key":"","snapid":-2,"hash":1315310604,"max":0,"pool":1,"namespace":"devicehealth","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["2.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["2.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:25.977 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:25.978 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:25.978 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"REPobject1","key":"","snapid":-2,"hash":623868980,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:25.978 INFO:tasks.ceph_objectstore_tool:found REPobject1 2026-02-24T16:09:25.978 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"REPobject2","key":"","snapid":-2,"hash":3521648588,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:25.978 INFO:tasks.ceph_objectstore_tool:found REPobject2 2026-02-24T16:09:25.978 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:25.978 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:25.978 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"rbd_info","key":"","snapid":-2,"hash":2886620986,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:25.978 INFO:tasks.ceph_objectstore_tool:parsing ["2.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["2.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["3.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["3.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["2.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["2.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["3.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["3.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"snapmapper","key":"","snapid":-2,"hash":6,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:parsing ["3.6",{"oid":"REPobject4","key":"","snapid":-2,"hash":833930126,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:25.979 INFO:tasks.ceph_objectstore_tool:found REPobject4 2026-02-24T16:09:25.980 INFO:tasks.ceph_objectstore_tool:process osd.2 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:09:25.980 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --op list 2026-02-24T16:09:26.124 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:26,123 seastar - Reactor backend: linux-aio 2026-02-24T16:09:26.134 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:26,134 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:26.135 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:26,134 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:26.137 INFO:teuthology.orchestra.run.trial053.stderr:==44395==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:26.897 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.897 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.898 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.899 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.900 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.911 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.911 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.911 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.911 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.911 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["2.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["2.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["3.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["3.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["3.2",{"oid":"REPobject3","key":"","snapid":-2,"hash":1871562002,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["3.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["3.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["3.4",{"oid":"REPobject1","key":"","snapid":-2,"hash":623868980,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.912 INFO:teuthology.orchestra.run.trial053.stdout:["3.4",{"oid":"REPobject2","key":"","snapid":-2,"hash":3521648588,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["3.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["3.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["3.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["3.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["3.5",{"oid":"REPobject5","key":"","snapid":-2,"hash":2508448421,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["2.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["2.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["2.3",{"oid":"rbd_trash","key":"","snapid":-2,"hash":1517589283,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["3.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["3.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["3.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:26.913 INFO:teuthology.orchestra.run.trial053.stdout:["3.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:28.443 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:28.444 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:28.444 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:28.444 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:28.444 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:28.444 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:28.481 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.482 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.483 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.484 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.485 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:parsing ["2.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:parsing ["2.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"REPobject3","key":"","snapid":-2,"hash":1871562002,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:found REPobject3 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"snapmapper","key":"","snapid":-2,"hash":4,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"REPobject1","key":"","snapid":-2,"hash":623868980,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.486 INFO:tasks.ceph_objectstore_tool:found REPobject1 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:parsing ["3.4",{"oid":"REPobject2","key":"","snapid":-2,"hash":3521648588,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:found REPobject2 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:parsing ["3.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:parsing ["3.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"REPobject5","key":"","snapid":-2,"hash":2508448421,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:found REPobject5 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:28.487 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:28.488 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"rbd_trash","key":"","snapid":-2,"hash":1517589283,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:28.488 INFO:tasks.ceph_objectstore_tool:parsing ["3.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.488 INFO:tasks.ceph_objectstore_tool:parsing ["3.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:28.488 INFO:tasks.ceph_objectstore_tool:parsing ["3.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:28.488 INFO:tasks.ceph_objectstore_tool:parsing ["3.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:28.488 INFO:tasks.ceph_objectstore_tool:process osd.3 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:09:28.488 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --op list 2026-02-24T16:09:28.632 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:28,631 seastar - Reactor backend: linux-aio 2026-02-24T16:09:28.643 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:28,642 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:28.643 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:28,642 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:28.646 INFO:teuthology.orchestra.run.trial053.stderr:==44426==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:29.409 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.409 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.409 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.409 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.409 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.410 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.411 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.412 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.412 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.412 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.412 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.412 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.412 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.412 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.412 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.412 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.425 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.425 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.425 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.425 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.425 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.425 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.425 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["2.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["2.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["2.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["2.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["2.3",{"oid":"rbd_trash","key":"","snapid":-2,"hash":1517589283,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["3.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["3.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["3.2",{"oid":"REPobject3","key":"","snapid":-2,"hash":1871562002,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["2.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["2.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:29.426 INFO:teuthology.orchestra.run.trial053.stdout:["2.2",{"oid":"rbd_info","key":"","snapid":-2,"hash":2886620986,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["2.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["2.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["3.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["3.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["2.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["2.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["2.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["2.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["3.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["3.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:29.427 INFO:teuthology.orchestra.run.trial053.stdout:["3.5",{"oid":"REPobject5","key":"","snapid":-2,"hash":2508448421,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:30.940 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:30.940 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:30.940 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:30.940 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:30.940 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:30.941 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:30.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osd_superblock","key":"","snapid":-2,"hash":3572033044,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.13","key":"","snapid":0,"hash":1679232780,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.20","key":"","snapid":0,"hash":1679229324,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.17","key":"","snapid":0,"hash":1679229644,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.19","key":"","snapid":0,"hash":1679229740,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.975 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.11","key":"","snapid":0,"hash":1679232684,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.15","key":"","snapid":0,"hash":1679232108,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.22","key":"","snapid":0,"hash":1679230700,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.10","key":"","snapid":0,"hash":1679231260,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.18","key":"","snapid":0,"hash":1679229852,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.21","key":"","snapid":0,"hash":1679229276,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.14","key":"","snapid":0,"hash":1679232220,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.16","key":"","snapid":0,"hash":1679232316,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.12","key":"","snapid":0,"hash":1679232636,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.1","key":"","snapid":0,"hash":3059696390,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.9","key":"","snapid":0,"hash":3059697030,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.976 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.5","key":"","snapid":0,"hash":3059697350,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.7","key":"","snapid":0,"hash":3059697446,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.3","key":"","snapid":0,"hash":3059695718,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.6","key":"","snapid":0,"hash":3059697558,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.2","key":"","snapid":0,"hash":3059695830,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.4","key":"","snapid":0,"hash":3059695926,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.8","key":"","snapid":0,"hash":3059696886,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.6","key":"","snapid":0,"hash":4251864065,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.2","key":"","snapid":0,"hash":4251863361,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.4","key":"","snapid":0,"hash":4251864993,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.8","key":"","snapid":0,"hash":4251864417,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.977 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.3","key":"","snapid":0,"hash":4251864593,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.7","key":"","snapid":0,"hash":4251864529,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.9","key":"","snapid":0,"hash":4251861553,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.1","key":"","snapid":0,"hash":4251863473,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"osdmap.5","key":"","snapid":0,"hash":4251864945,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.10","key":"","snapid":0,"hash":4108959747,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.18","key":"","snapid":0,"hash":4108966531,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.21","key":"","snapid":0,"hash":4108965955,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.14","key":"","snapid":0,"hash":4108961731,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.16","key":"","snapid":0,"hash":4108960803,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.12","key":"","snapid":0,"hash":4108960099,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.978 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.22","key":"","snapid":0,"hash":4108966163,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.15","key":"","snapid":0,"hash":4108960915,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.19","key":"","snapid":0,"hash":4108966483,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.11","key":"","snapid":0,"hash":4108960211,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.13","key":"","snapid":0,"hash":4108961331,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.20","key":"","snapid":0,"hash":4108966067,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["meta",{"oid":"inc_osdmap.17","key":"","snapid":0,"hash":4108961267,"max":0,"pool":-1,"namespace":"","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["2.0",{"oid":"","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["2.0",{"oid":"snapmapper","key":"","snapid":-2,"hash":0,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"snapmapper","key":"","snapid":-2,"hash":3,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:30.979 INFO:tasks.ceph_objectstore_tool:parsing ["2.3",{"oid":"rbd_trash","key":"","snapid":-2,"hash":1517589283,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:parsing ["3.2",{"oid":"REPobject3","key":"","snapid":-2,"hash":1871562002,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:found REPobject3 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"snapmapper","key":"","snapid":-2,"hash":2,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:parsing ["2.2",{"oid":"rbd_info","key":"","snapid":-2,"hash":2886620986,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:parsing ["2.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:parsing ["2.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:30.980 INFO:tasks.ceph_objectstore_tool:parsing ["3.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:parsing ["3.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:parsing ["2.1",{"oid":"","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:parsing ["2.1",{"oid":"snapmapper","key":"","snapid":-2,"hash":1,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:parsing ["2.7",{"oid":"","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":"","max":0}] 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:parsing ["2.7",{"oid":"snapmapper","key":"","snapid":-2,"hash":7,"max":0,"pool":2,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"snapmapper","key":"","snapid":-2,"hash":5,"max":0,"pool":3,"namespace":".internal_pg_local","max":0}] 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:parsing ["3.5",{"oid":"REPobject5","key":"","snapid":-2,"hash":2508448421,"max":0,"pool":3,"namespace":"","max":0}] 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:found REPobject5 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:Finished --op list 2026-02-24T16:09:30.981 INFO:tasks.ceph_objectstore_tool:Found: {'REPobject1': {'xattr': {}, 'omap': {}, 'pg2json': {'3.4': '{"oid": "REPobject1", "key": "", "snapid": -2, "hash": 623868980, "max": 0, "pool": 3, "namespace": ""}'}}, 'REPobject2': {'xattr': {'key2-1': 'val2-1'}, 'omapheader': 'hdr2', 'omap': {'okey2-1': 'oval2-1'}, 'pg2json': {'3.4': '{"oid": "REPobject2", "key": "", "snapid": -2, "hash": 3521648588, "max": 0, "pool": 3, "namespace": ""}'}}, 'REPobject3': {'xattr': {'key3-1': 'val3-1', 'key3-2': 'val3-2'}, 'omapheader': 'hdr3', 'omap': {'okey3-1': 'oval3-1', 'okey3-2': 'oval3-2'}, 'pg2json': {'3.2': '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}'}}, 'REPobject4': {'xattr': {'key4-1': 'val4-1', 'key4-2': 'val4-2', 'key4-3': 'val4-3'}, 'omapheader': 'hdr4', 'omap': {'okey4-1': 'oval4-1', 'okey4-2': 'oval4-2', 'okey4-3': 'oval4-3'}, 'pg2json': {'3.6': '{"oid": "REPobject4", "key": "", "snapid": -2, "hash": 833930126, "max": 0, "pool": 3, "namespace": ""}'}}, 'REPobject5': {'xattr': {'key5-1': 'val5-1', 'key5-2': 'val5-2', 'key5-3': 'val5-3', 'key5-4': 'val5-4'}, 'omapheader': 'hdr5', 'omap': {'okey5-1': 'oval5-1', 'okey5-2': 'oval5-2', 'okey5-3': 'oval5-3', 'okey5-4': 'oval5-4'}, 'pg2json': {'3.5': '{"oid": "REPobject5", "key": "", "snapid": -2, "hash": 2508448421, "max": 0, "pool": 3, "namespace": ""}'}}} 2026-02-24T16:09:30.982 INFO:tasks.ceph_objectstore_tool:Found pgs: {'3.5', '3.2', '3.4', '3.6'} 2026-02-24T16:09:30.982 INFO:tasks.ceph_objectstore_tool:Found objects by pgs: {'3.6': ['REPobject4', 'REPobject4'], '3.4': ['REPobject1', 'REPobject2', 'REPobject1', 'REPobject2'], '3.2': ['REPobject3', 'REPobject3'], '3.5': ['REPobject5', 'REPobject5']} 2026-02-24T16:09:30.982 INFO:tasks.ceph_objectstore_tool:Test get-bytes and set-bytes 2026-02-24T16:09:30.982 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-bytes /home/ubuntu/cephtest/ceph.data/get 2026-02-24T16:09:31.125 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:31,124 seastar - Reactor backend: linux-aio 2026-02-24T16:09:31.137 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:31,136 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:31.137 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:31,136 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:31.139 INFO:teuthology.orchestra.run.trial053.stderr:==44457==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:33.188 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:33.188 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:33.188 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:33.188 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:33.189 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:33.189 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:33.223 DEBUG:teuthology.orchestra.run.trial053:> diff -q /home/ubuntu/cephtest/ceph.data/REPobject3 /home/ubuntu/cephtest/ceph.data/get 2026-02-24T16:09:33.240 DEBUG:tasks.ceph_objectstore_tool:Got original data from get-bytes REPobject3 successfully! 2026-02-24T16:09:33.240 DEBUG:teuthology.orchestra.run.trial053:> rm -f /home/ubuntu/cephtest/ceph.data/get 2026-02-24T16:09:33.297 DEBUG:tasks.ceph_objectstore_tool:Setting new data to REPobject3 2026-02-24T16:09:33.297 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:09:33.298 DEBUG:teuthology.orchestra.run.trial053:> dd of=/home/ubuntu/cephtest/ceph.data/set 2026-02-24T16:09:33.355 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/set 2026-02-24T16:09:33.539 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:33,538 seastar - Reactor backend: linux-aio 2026-02-24T16:09:33.547 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:33,546 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:33.547 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:33,546 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:33.550 INFO:teuthology.orchestra.run.trial053.stderr:==44557==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:34.058 INFO:teuthology.orchestra.run.trial053.stdout:set bytes success: data size=64 2026-02-24T16:09:35.554 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:35.554 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:35.554 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:35.554 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:35.554 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:35.554 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:35.584 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-bytes - 2026-02-24T16:09:35.725 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:35,724 seastar - Reactor backend: linux-aio 2026-02-24T16:09:35.734 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:35,733 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:35.734 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:35,733 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:35.737 INFO:teuthology.orchestra.run.trial053.stderr:==44588==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:37.724 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:37.725 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:37.725 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:37.725 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:37.725 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:37.725 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:37.725 INFO:teuthology.orchestra.run.trial053.stdout:set-bytes going into /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-24T16:09:37.759 DEBUG:tasks.ceph_objectstore_tool:Got data after set-bytes to REPobject3 successfully! 2026-02-24T16:09:37.759 DEBUG:tasks.ceph_objectstore_tool:Retrning REPobject3 to orginal data 2026-02-24T16:09:37.759 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-24T16:09:37.908 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:37,907 seastar - Reactor backend: linux-aio 2026-02-24T16:09:37.920 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:37,919 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:37.921 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:37,920 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:37.923 INFO:teuthology.orchestra.run.trial053.stderr:==44620==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:38.417 INFO:teuthology.orchestra.run.trial053.stdout:set bytes success: data size=320000 2026-02-24T16:09:39.960 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:39.960 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:39.960 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:39.960 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:39.960 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:39.960 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:39.992 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-bytes /home/ubuntu/cephtest/ceph.data/get 2026-02-24T16:09:40.137 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:40,136 seastar - Reactor backend: linux-aio 2026-02-24T16:09:40.145 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:40,144 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:40.145 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:40,145 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:40.148 INFO:teuthology.orchestra.run.trial053.stderr:==44651==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:42.230 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:42.230 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:42.230 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:42.230 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:42.230 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:42.230 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:42.264 DEBUG:teuthology.orchestra.run.trial053:> diff -q /home/ubuntu/cephtest/ceph.data/REPobject3 /home/ubuntu/cephtest/ceph.data/get 2026-02-24T16:09:42.281 DEBUG:tasks.ceph_objectstore_tool:Got original data from get-bytes REPobject3 successfully! 2026-02-24T16:09:42.281 DEBUG:teuthology.orchestra.run.trial053:> rm -f /home/ubuntu/cephtest/ceph.data/get 2026-02-24T16:09:42.337 DEBUG:tasks.ceph_objectstore_tool:Setting new data to REPobject3 2026-02-24T16:09:42.338 DEBUG:teuthology.orchestra.run.trial053:> set -ex 2026-02-24T16:09:42.338 DEBUG:teuthology.orchestra.run.trial053:> dd of=/home/ubuntu/cephtest/ceph.data/set 2026-02-24T16:09:42.393 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/set 2026-02-24T16:09:42.581 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:42,580 seastar - Reactor backend: linux-aio 2026-02-24T16:09:42.595 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:42,594 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:42.595 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:42,594 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:42.598 INFO:teuthology.orchestra.run.trial053.stderr:==44751==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:43.189 INFO:teuthology.orchestra.run.trial053.stdout:set bytes success: data size=64 2026-02-24T16:09:44.697 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:44.697 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:44.697 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:44.697 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:44.698 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:44.698 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:44.729 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-bytes - 2026-02-24T16:09:44.873 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:44,872 seastar - Reactor backend: linux-aio 2026-02-24T16:09:44.883 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:44,882 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:44.883 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:44,882 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:44.886 INFO:teuthology.orchestra.run.trial053.stderr:==44782==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:46.995 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:46.996 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:46.996 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:46.996 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:46.996 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:46.996 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:46.996 INFO:teuthology.orchestra.run.trial053.stdout:set-bytes going into /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-24T16:09:47.027 DEBUG:tasks.ceph_objectstore_tool:Got data after set-bytes to REPobject3 successfully! 2026-02-24T16:09:47.027 DEBUG:tasks.ceph_objectstore_tool:Retrning REPobject3 to orginal data 2026-02-24T16:09:47.027 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' set-bytes /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-24T16:09:47.174 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:47,173 seastar - Reactor backend: linux-aio 2026-02-24T16:09:47.184 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:47,183 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:47.184 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:47,183 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:47.187 INFO:teuthology.orchestra.run.trial053.stderr:==44813==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:47.648 INFO:teuthology.orchestra.run.trial053.stderr:Reactor stalled for 260 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0x75a38dc 0x741fb03 0x745284d 0x7456bc4 0x7456e32 0x7456f7a 0x7457439 /lib64/libc.so.6+0x3fc2f 0x38fdf27 0x3912514 0x391284c 0x3948a49 0x3911b87 0x33865ad 0x33872a2 0x344803a 0x3352600 0x33a5342 0x33ec559 0x33ec7d2 0x354ec1c 0x341ee14 0x344819d 0x337d58e 0x35300d9 0x3530168 0x353020c 0x2fa9910 0x2ee5ccd 0x2f7a57b 0x304751e 0x74f6c65 0x7427916 0x74caeef 0x74fd607 0x764722a 0x76478a6 0x1263ad1 0x7aca8b2 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-24T16:09:47.671 INFO:teuthology.orchestra.run.trial053.stdout:set bytes success: data size=320000 2026-02-24T16:09:49.133 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:49.133 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:49.133 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:49.133 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:49.133 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:49.133 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:49.166 INFO:tasks.ceph_objectstore_tool:Test list-attrs get-attr 2026-02-24T16:09:49.166 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' list-attrs 2026-02-24T16:09:49.314 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:49,313 seastar - Reactor backend: linux-aio 2026-02-24T16:09:49.332 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:49,331 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:49.332 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:49,331 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:49.335 INFO:teuthology.orchestra.run.trial053.stderr:==44844==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:49.825 INFO:teuthology.orchestra.run.trial053.stdout:_ 2026-02-24T16:09:49.825 INFO:teuthology.orchestra.run.trial053.stdout:_key3-1 2026-02-24T16:09:49.825 INFO:teuthology.orchestra.run.trial053.stdout:_key3-2 2026-02-24T16:09:49.825 INFO:teuthology.orchestra.run.trial053.stdout:omap_header 2026-02-24T16:09:49.825 INFO:teuthology.orchestra.run.trial053.stdout:snapset 2026-02-24T16:09:51.328 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:51.328 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:51.328 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:51.328 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:51.328 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:51.328 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:51.361 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-attr _key3-1 2026-02-24T16:09:51.503 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:51,502 seastar - Reactor backend: linux-aio 2026-02-24T16:09:51.513 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:51,512 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:51.513 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:51,512 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:51.516 INFO:teuthology.orchestra.run.trial053.stderr:==44875==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:53.482 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:53.482 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:53.483 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:53.483 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:53.483 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:53.483 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:53.513 INFO:teuthology.orchestra.run.trial053.stdout:val3-1 2026-02-24T16:09:53.513 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-attr _key3-2 2026-02-24T16:09:53.663 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:53,662 seastar - Reactor backend: linux-aio 2026-02-24T16:09:53.678 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:53,677 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:53.678 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:53,677 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:53.681 INFO:teuthology.orchestra.run.trial053.stderr:==44906==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:55.633 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:55.634 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:55.634 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:55.634 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:55.634 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:55.634 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:55.664 INFO:teuthology.orchestra.run.trial053.stdout:val3-2 2026-02-24T16:09:55.665 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' list-attrs 2026-02-24T16:09:55.820 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:55,819 seastar - Reactor backend: linux-aio 2026-02-24T16:09:55.828 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:55,827 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:55.828 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:55,827 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:55.831 INFO:teuthology.orchestra.run.trial053.stderr:==44937==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:56.300 INFO:teuthology.orchestra.run.trial053.stdout:_ 2026-02-24T16:09:56.301 INFO:teuthology.orchestra.run.trial053.stdout:_key3-1 2026-02-24T16:09:56.301 INFO:teuthology.orchestra.run.trial053.stdout:_key3-2 2026-02-24T16:09:56.301 INFO:teuthology.orchestra.run.trial053.stdout:omap_header 2026-02-24T16:09:56.301 INFO:teuthology.orchestra.run.trial053.stdout:snapset 2026-02-24T16:09:57.803 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:57.803 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:57.804 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:57.804 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:57.804 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:57.804 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:09:57.835 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-attr _key3-1 2026-02-24T16:09:57.981 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:57,980 seastar - Reactor backend: linux-aio 2026-02-24T16:09:57.988 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:57,987 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:57.988 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:09:57,987 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:09:57.991 INFO:teuthology.orchestra.run.trial053.stderr:==44968==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:09:59.979 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:59.979 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:09:59.979 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:09:59.979 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:09:59.979 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:09:59.979 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:10:00.011 INFO:teuthology.orchestra.run.trial053.stdout:val3-1 2026-02-24T16:10:00.012 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --pgid 3.2 '{"oid": "REPobject3", "key": "", "snapid": -2, "hash": 1871562002, "max": 0, "pool": 3, "namespace": ""}' get-attr _key3-2 2026-02-24T16:10:00.156 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:00,155 seastar - Reactor backend: linux-aio 2026-02-24T16:10:00.164 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:00,163 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:00.164 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:00,163 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:00.167 INFO:teuthology.orchestra.run.trial053.stderr:==44999==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:10:02.188 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:02.188 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:10:02.188 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:10:02.188 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:10:02.188 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:02.189 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:10:02.220 INFO:teuthology.orchestra.run.trial053.stdout:val3-2 2026-02-24T16:10:02.221 INFO:tasks.ceph_objectstore_tool:Test pg info 2026-02-24T16:10:02.221 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-1 --device-type SSD --op info --pgid 3.7 2026-02-24T16:10:02.364 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:02,363 seastar - Reactor backend: linux-aio 2026-02-24T16:10:02.374 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:02,374 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:02.375 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:02,374 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:02.377 INFO:teuthology.orchestra.run.trial053.stderr:==45031==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:10:02.962 INFO:teuthology.orchestra.run.trial053.stdout:object name is empty, use pgmeta oid 2026-02-24T16:10:02.962 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:02.962 INFO:teuthology.orchestra.run.trial053.stdout: "pgid": "3.7", 2026-02-24T16:10:02.962 INFO:teuthology.orchestra.run.trial053.stdout: "shard": "255", 2026-02-24T16:10:02.962 INFO:teuthology.orchestra.run.trial053.stdout: "last_update": "0'0", 2026-02-24T16:10:02.962 INFO:teuthology.orchestra.run.trial053.stdout: "last_complete": "0'0", 2026-02-24T16:10:02.962 INFO:teuthology.orchestra.run.trial053.stdout: "log_tail": "0'0", 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "last_user_version": 0, 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "last_backfill": "MAX", 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "partial_writes_last_complete": [], 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "purged_snaps": [], 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "history": { 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "epoch_created": 0, 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "epoch_pool_created": 0, 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_started": 0, 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "last_interval_started": 0, 2026-02-24T16:10:02.963 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_clean": 0, 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "last_interval_clean": 0, 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_split": 0, 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_marked_full": 0, 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "same_up_since": 0, 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "same_interval_since": 0, 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "same_primary_since": 0, 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub": "0'0", 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_stamp": "0.000000", 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub": "0'0", 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-24T16:10:02.964 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "prior_readable_until_ub": 0 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "stats": { 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "version": "0'0", 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "reported_seq": 0, 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "reported_epoch": 0, 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "state": "unknown", 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "last_fresh": "0.000000", 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "last_change": "0.000000", 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "last_active": "0.000000", 2026-02-24T16:10:02.965 INFO:teuthology.orchestra.run.trial053.stdout: "last_peered": "0.000000", 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean": "0.000000", 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "last_became_active": "0.000000", 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "last_became_peered": "0.000000", 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "last_unstale": "0.000000", 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "last_undegraded": "0.000000", 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "last_fullsized": "0.000000", 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "mapping_epoch": 0, 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "log_start": "0'0", 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "ondisk_log_start": "0'0", 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "created": 0, 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_clean": 0, 2026-02-24T16:10:02.966 INFO:teuthology.orchestra.run.trial053.stdout: "parent": "0.0", 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "parent_split_bits": 0, 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub": "0'0", 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_stamp": "0.000000", 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub": "0'0", 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "objects_scrubbed": 0, 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "log_size": 0, 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "log_dups_size": 0, 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "ondisk_log_size": 0, 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "stats_invalid": false, 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "dirty_stats_invalid": false, 2026-02-24T16:10:02.967 INFO:teuthology.orchestra.run.trial053.stdout: "omap_stats_invalid": false, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "hitset_stats_invalid": false, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "hitset_bytes_stats_invalid": false, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "pin_stats_invalid": false, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "manifest_stats_invalid": false, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "snaptrimq_len": 0, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_duration": 0, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "scrub_schedule": "--", 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "scrub_duration": 0, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "objects_trimmed": 0, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "snaptrim_duration": 0, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "stat_sum": { 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes": 0, 2026-02-24T16:10:02.968 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_object_clones": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_object_copies": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_missing_on_primary": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_missing": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_degraded": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_misplaced": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_unfound": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_dirty": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_whiteouts": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_read": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_read_kb": 0, 2026-02-24T16:10:02.969 INFO:teuthology.orchestra.run.trial053.stdout: "num_write": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_write_kb": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_scrub_errors": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_shallow_scrub_errors": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_deep_scrub_errors": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_recovered": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes_recovered": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_keys_recovered": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_omap": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_hit_set_archive": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes_hit_set_archive": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush": 0, 2026-02-24T16:10:02.970 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_kb": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_kb": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_promote": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_mode_high": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_mode_low": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_mode_some": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_mode_full": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_pinned": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_legacy_snapsets": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_large_omap_objects": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_manifest": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_omap_bytes": 0, 2026-02-24T16:10:02.971 INFO:teuthology.orchestra.run.trial053.stdout: "num_omap_keys": 0, 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_repaired": 0 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "up": [], 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "acting": [], 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "avail_no_missing": [], 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "object_location_counts": [], 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "blocked_by": [], 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "up_primary": -1, 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "acting_primary": -1, 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "purged_snaps": [] 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "empty": 1, 2026-02-24T16:10:02.972 INFO:teuthology.orchestra.run.trial053.stdout: "dne": 1, 2026-02-24T16:10:02.973 INFO:teuthology.orchestra.run.trial053.stdout: "incomplete": 0, 2026-02-24T16:10:02.973 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_started": 0, 2026-02-24T16:10:02.973 INFO:teuthology.orchestra.run.trial053.stdout: "hit_set_history": { 2026-02-24T16:10:02.973 INFO:teuthology.orchestra.run.trial053.stdout: "current_last_update": "0'0", 2026-02-24T16:10:02.973 INFO:teuthology.orchestra.run.trial053.stdout: "history": [] 2026-02-24T16:10:02.973 INFO:teuthology.orchestra.run.trial053.stdout: } 2026-02-24T16:10:02.973 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:04.494 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:04.495 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:10:04.495 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:10:04.495 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:10:04.495 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:04.495 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:10:04.528 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-2 --device-type SSD --op info --pgid 3.2 2026-02-24T16:10:04.676 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:04,675 seastar - Reactor backend: linux-aio 2026-02-24T16:10:04.686 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:04,685 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:04.686 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:04,685 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:04.689 INFO:teuthology.orchestra.run.trial053.stderr:==45062==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:10:05.178 INFO:teuthology.orchestra.run.trial053.stdout:object name is empty, use pgmeta oid 2026-02-24T16:10:05.178 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:05.178 INFO:teuthology.orchestra.run.trial053.stdout: "pgid": "3.2", 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "shard": "255", 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "last_update": "0'0", 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "last_complete": "0'0", 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "log_tail": "0'0", 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "last_user_version": 0, 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "last_backfill": "MAX", 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "partial_writes_last_complete": [], 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "purged_snaps": [], 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "history": { 2026-02-24T16:10:05.179 INFO:teuthology.orchestra.run.trial053.stdout: "epoch_created": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "epoch_pool_created": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_started": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "last_interval_started": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_clean": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "last_interval_clean": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_split": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_marked_full": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "same_up_since": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "same_interval_since": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "same_primary_since": 0, 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub": "0'0", 2026-02-24T16:10:05.180 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_stamp": "0.000000", 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub": "0'0", 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "prior_readable_until_ub": 0 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "stats": { 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "version": "0'0", 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "reported_seq": 0, 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "reported_epoch": 0, 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "state": "unknown", 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "last_fresh": "0.000000", 2026-02-24T16:10:05.181 INFO:teuthology.orchestra.run.trial053.stdout: "last_change": "0.000000", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "last_active": "0.000000", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "last_peered": "0.000000", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean": "0.000000", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "last_became_active": "0.000000", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "last_became_peered": "0.000000", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "last_unstale": "0.000000", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "last_undegraded": "0.000000", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "last_fullsized": "0.000000", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "mapping_epoch": 0, 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "log_start": "0'0", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "ondisk_log_start": "0'0", 2026-02-24T16:10:05.182 INFO:teuthology.orchestra.run.trial053.stdout: "created": 0, 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_clean": 0, 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "parent": "0.0", 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "parent_split_bits": 0, 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub": "0'0", 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_stamp": "0.000000", 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub": "0'0", 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "objects_scrubbed": 0, 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "log_size": 0, 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "log_dups_size": 0, 2026-02-24T16:10:05.183 INFO:teuthology.orchestra.run.trial053.stdout: "ondisk_log_size": 0, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "stats_invalid": false, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "dirty_stats_invalid": false, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "omap_stats_invalid": false, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "hitset_stats_invalid": false, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "hitset_bytes_stats_invalid": false, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "pin_stats_invalid": false, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "manifest_stats_invalid": false, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "snaptrimq_len": 0, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_duration": 0, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "scrub_schedule": "--", 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "scrub_duration": 0, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "objects_trimmed": 0, 2026-02-24T16:10:05.184 INFO:teuthology.orchestra.run.trial053.stdout: "snaptrim_duration": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "stat_sum": { 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_object_clones": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_object_copies": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_missing_on_primary": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_missing": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_degraded": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_misplaced": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_unfound": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_dirty": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_whiteouts": 0, 2026-02-24T16:10:05.185 INFO:teuthology.orchestra.run.trial053.stdout: "num_read": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_read_kb": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_write": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_write_kb": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_scrub_errors": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_shallow_scrub_errors": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_deep_scrub_errors": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_recovered": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes_recovered": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_keys_recovered": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_omap": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_hit_set_archive": 0, 2026-02-24T16:10:05.186 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes_hit_set_archive": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_kb": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_kb": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_promote": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_mode_high": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_mode_low": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_mode_some": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_mode_full": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_pinned": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_legacy_snapsets": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_large_omap_objects": 0, 2026-02-24T16:10:05.187 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_manifest": 0, 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "num_omap_bytes": 0, 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "num_omap_keys": 0, 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_repaired": 0 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "up": [], 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "acting": [], 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "avail_no_missing": [], 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "object_location_counts": [], 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "blocked_by": [], 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "up_primary": -1, 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "acting_primary": -1, 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: "purged_snaps": [] 2026-02-24T16:10:05.188 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:05.189 INFO:teuthology.orchestra.run.trial053.stdout: "empty": 1, 2026-02-24T16:10:05.189 INFO:teuthology.orchestra.run.trial053.stdout: "dne": 1, 2026-02-24T16:10:05.189 INFO:teuthology.orchestra.run.trial053.stdout: "incomplete": 0, 2026-02-24T16:10:05.189 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_started": 0, 2026-02-24T16:10:05.189 INFO:teuthology.orchestra.run.trial053.stdout: "hit_set_history": { 2026-02-24T16:10:05.189 INFO:teuthology.orchestra.run.trial053.stdout: "current_last_update": "0'0", 2026-02-24T16:10:05.189 INFO:teuthology.orchestra.run.trial053.stdout: "history": [] 2026-02-24T16:10:05.189 INFO:teuthology.orchestra.run.trial053.stdout: } 2026-02-24T16:10:05.189 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:06.681 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:06.681 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:10:06.681 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:10:06.682 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:10:06.682 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:06.682 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:10:06.712 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --op info --pgid 3.2 2026-02-24T16:10:06.862 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:06,861 seastar - Reactor backend: linux-aio 2026-02-24T16:10:06.869 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:06,868 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:06.869 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:06,868 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:06.872 INFO:teuthology.orchestra.run.trial053.stderr:==45093==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:10:07.360 INFO:teuthology.orchestra.run.trial053.stdout:object name is empty, use pgmeta oid 2026-02-24T16:10:07.361 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:07.361 INFO:teuthology.orchestra.run.trial053.stdout: "pgid": "3.2", 2026-02-24T16:10:07.361 INFO:teuthology.orchestra.run.trial053.stdout: "shard": "255", 2026-02-24T16:10:07.361 INFO:teuthology.orchestra.run.trial053.stdout: "last_update": "0'0", 2026-02-24T16:10:07.361 INFO:teuthology.orchestra.run.trial053.stdout: "last_complete": "0'0", 2026-02-24T16:10:07.361 INFO:teuthology.orchestra.run.trial053.stdout: "log_tail": "0'0", 2026-02-24T16:10:07.361 INFO:teuthology.orchestra.run.trial053.stdout: "last_user_version": 0, 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "last_backfill": "MAX", 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "partial_writes_last_complete": [], 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "purged_snaps": [], 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "history": { 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "epoch_created": 0, 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "epoch_pool_created": 0, 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_started": 0, 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "last_interval_started": 0, 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_clean": 0, 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "last_interval_clean": 0, 2026-02-24T16:10:07.362 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_split": 0, 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_marked_full": 0, 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "same_up_since": 0, 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "same_interval_since": 0, 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "same_primary_since": 0, 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub": "0'0", 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_stamp": "0.000000", 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub": "0'0", 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "prior_readable_until_ub": 0 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:07.363 INFO:teuthology.orchestra.run.trial053.stdout: "stats": { 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "version": "0'0", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "reported_seq": 0, 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "reported_epoch": 0, 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "state": "unknown", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "last_fresh": "0.000000", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "last_change": "0.000000", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "last_active": "0.000000", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "last_peered": "0.000000", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean": "0.000000", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "last_became_active": "0.000000", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "last_became_peered": "0.000000", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "last_unstale": "0.000000", 2026-02-24T16:10:07.364 INFO:teuthology.orchestra.run.trial053.stdout: "last_undegraded": "0.000000", 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "last_fullsized": "0.000000", 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "mapping_epoch": 0, 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "log_start": "0'0", 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "ondisk_log_start": "0'0", 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "created": 0, 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_clean": 0, 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "parent": "0.0", 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "parent_split_bits": 0, 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub": "0'0", 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_stamp": "0.000000", 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub": "0'0", 2026-02-24T16:10:07.365 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "objects_scrubbed": 0, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "log_size": 0, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "log_dups_size": 0, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "ondisk_log_size": 0, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "stats_invalid": false, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "dirty_stats_invalid": false, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "omap_stats_invalid": false, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "hitset_stats_invalid": false, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "hitset_bytes_stats_invalid": false, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "pin_stats_invalid": false, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "manifest_stats_invalid": false, 2026-02-24T16:10:07.366 INFO:teuthology.orchestra.run.trial053.stdout: "snaptrimq_len": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_duration": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "scrub_schedule": "--", 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "scrub_duration": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "objects_trimmed": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "snaptrim_duration": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "stat_sum": { 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "num_object_clones": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "num_object_copies": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_missing_on_primary": 0, 2026-02-24T16:10:07.367 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_missing": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_degraded": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_misplaced": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_unfound": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_dirty": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_whiteouts": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_read": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_read_kb": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_write": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_write_kb": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_scrub_errors": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_shallow_scrub_errors": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_deep_scrub_errors": 0, 2026-02-24T16:10:07.368 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_recovered": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes_recovered": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_keys_recovered": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_omap": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_hit_set_archive": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes_hit_set_archive": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_kb": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_kb": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_promote": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_mode_high": 0, 2026-02-24T16:10:07.369 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_mode_low": 0, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_mode_some": 0, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_mode_full": 0, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_pinned": 0, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "num_legacy_snapsets": 0, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "num_large_omap_objects": 0, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_manifest": 0, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "num_omap_bytes": 0, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "num_omap_keys": 0, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_repaired": 0 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "up": [], 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "acting": [], 2026-02-24T16:10:07.370 INFO:teuthology.orchestra.run.trial053.stdout: "avail_no_missing": [], 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "object_location_counts": [], 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "blocked_by": [], 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "up_primary": -1, 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "acting_primary": -1, 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "purged_snaps": [] 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "empty": 1, 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "dne": 1, 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "incomplete": 0, 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_started": 0, 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "hit_set_history": { 2026-02-24T16:10:07.371 INFO:teuthology.orchestra.run.trial053.stdout: "current_last_update": "0'0", 2026-02-24T16:10:07.372 INFO:teuthology.orchestra.run.trial053.stdout: "history": [] 2026-02-24T16:10:07.372 INFO:teuthology.orchestra.run.trial053.stdout: } 2026-02-24T16:10:07.372 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:08.836 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:08.836 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:10:08.836 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:10:08.836 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:10:08.836 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:08.836 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:10:08.868 DEBUG:teuthology.orchestra.run.trial053:> sudo crimson-objectstore-tool --data-path /var/lib/ceph/osd/ceph-3 --device-type SSD --op info --pgid 3.7 2026-02-24T16:10:09.008 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:09,007 seastar - Reactor backend: linux-aio 2026-02-24T16:10:09.016 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:09,015 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:09.016 INFO:teuthology.orchestra.run.trial053.stderr:INFO 2026-02-24 16:10:09,015 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-24T16:10:09.019 INFO:teuthology.orchestra.run.trial053.stderr:==45124==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-24T16:10:09.480 INFO:teuthology.orchestra.run.trial053.stdout:object name is empty, use pgmeta oid 2026-02-24T16:10:09.480 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "pgid": "3.7", 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "shard": "255", 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "last_update": "0'0", 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "last_complete": "0'0", 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "log_tail": "0'0", 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "last_user_version": 0, 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "last_backfill": "MAX", 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "partial_writes_last_complete": [], 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "partial_writes_last_complete_epoch": "0", 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "purged_snaps": [], 2026-02-24T16:10:09.481 INFO:teuthology.orchestra.run.trial053.stdout: "history": { 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "epoch_created": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "epoch_pool_created": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_started": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "last_interval_started": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_clean": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "last_interval_clean": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_split": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_marked_full": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "same_up_since": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "same_interval_since": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "same_primary_since": 0, 2026-02-24T16:10:09.482 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub": "0'0", 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_stamp": "0.000000", 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub": "0'0", 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "prior_readable_until_ub": 0 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "stats": { 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "version": "0'0", 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "reported_seq": 0, 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "reported_epoch": 0, 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "state": "unknown", 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "last_fresh": "0.000000", 2026-02-24T16:10:09.483 INFO:teuthology.orchestra.run.trial053.stdout: "last_change": "0.000000", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "last_active": "0.000000", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "last_peered": "0.000000", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean": "0.000000", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "last_became_active": "0.000000", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "last_became_peered": "0.000000", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "last_unstale": "0.000000", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "last_undegraded": "0.000000", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "last_fullsized": "0.000000", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "mapping_epoch": 0, 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "log_start": "0'0", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "ondisk_log_start": "0'0", 2026-02-24T16:10:09.484 INFO:teuthology.orchestra.run.trial053.stdout: "created": 0, 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_clean": 0, 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "parent": "0.0", 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "parent_split_bits": 0, 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub": "0'0", 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_stamp": "0.000000", 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub": "0'0", 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "last_deep_scrub_stamp": "0.000000", 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "last_clean_scrub_stamp": "0.000000", 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "objects_scrubbed": 0, 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "log_size": 0, 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "log_dups_size": 0, 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "ondisk_log_size": 0, 2026-02-24T16:10:09.485 INFO:teuthology.orchestra.run.trial053.stdout: "stats_invalid": false, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "dirty_stats_invalid": false, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "omap_stats_invalid": false, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "hitset_stats_invalid": false, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "hitset_bytes_stats_invalid": false, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "pin_stats_invalid": false, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "manifest_stats_invalid": false, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "snaptrimq_len": 0, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "last_scrub_duration": 0, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "scrub_schedule": "--", 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "scrub_duration": 0, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "objects_trimmed": 0, 2026-02-24T16:10:09.486 INFO:teuthology.orchestra.run.trial053.stdout: "snaptrim_duration": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "stat_sum": { 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_object_clones": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_object_copies": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_missing_on_primary": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_missing": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_degraded": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_misplaced": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_unfound": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_dirty": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_whiteouts": 0, 2026-02-24T16:10:09.487 INFO:teuthology.orchestra.run.trial053.stdout: "num_read": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_read_kb": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_write": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_write_kb": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_scrub_errors": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_shallow_scrub_errors": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_deep_scrub_errors": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_recovered": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes_recovered": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_keys_recovered": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_omap": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_hit_set_archive": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_bytes_hit_set_archive": 0, 2026-02-24T16:10:09.488 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_kb": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_kb": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_promote": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_mode_high": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_flush_mode_low": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_mode_some": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_evict_mode_full": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_pinned": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_legacy_snapsets": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_large_omap_objects": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_manifest": 0, 2026-02-24T16:10:09.489 INFO:teuthology.orchestra.run.trial053.stdout: "num_omap_bytes": 0, 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "num_omap_keys": 0, 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "num_objects_repaired": 0 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "up": [], 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "acting": [], 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "avail_no_missing": [], 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "object_location_counts": [], 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "blocked_by": [], 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "up_primary": -1, 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "acting_primary": -1, 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: "purged_snaps": [] 2026-02-24T16:10:09.490 INFO:teuthology.orchestra.run.trial053.stdout: }, 2026-02-24T16:10:09.491 INFO:teuthology.orchestra.run.trial053.stdout: "empty": 1, 2026-02-24T16:10:09.491 INFO:teuthology.orchestra.run.trial053.stdout: "dne": 1, 2026-02-24T16:10:09.491 INFO:teuthology.orchestra.run.trial053.stdout: "incomplete": 0, 2026-02-24T16:10:09.491 INFO:teuthology.orchestra.run.trial053.stdout: "last_epoch_started": 0, 2026-02-24T16:10:09.491 INFO:teuthology.orchestra.run.trial053.stdout: "hit_set_history": { 2026-02-24T16:10:09.491 INFO:teuthology.orchestra.run.trial053.stdout: "current_last_update": "0'0", 2026-02-24T16:10:09.491 INFO:teuthology.orchestra.run.trial053.stdout: "history": [] 2026-02-24T16:10:09.491 INFO:teuthology.orchestra.run.trial053.stdout: } 2026-02-24T16:10:09.491 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:10.971 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:10.971 INFO:teuthology.orchestra.run.trial053.stderr:Suppressions used: 2026-02-24T16:10:10.971 INFO:teuthology.orchestra.run.trial053.stderr: count bytes template 2026-02-24T16:10:10.971 INFO:teuthology.orchestra.run.trial053.stderr: 1 8 MallocExtension::Register 2026-02-24T16:10:10.971 INFO:teuthology.orchestra.run.trial053.stderr:----------------------------------------------------- 2026-02-24T16:10:10.971 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:10:11.002 INFO:tasks.ceph_objectstore_tool:SKIPPING: test_pg_logging - PG logging not implemented 2026-02-24T16:10:11.003 INFO:tasks.ceph_objectstore_tool:SKIPPING: test_pg_export - PG export not implemented 2026-02-24T16:10:11.003 INFO:tasks.ceph_objectstore_tool:SKIPPING: test_pg_removal - PG removal not implemented 2026-02-24T16:10:11.003 INFO:tasks.ceph_objectstore_tool:SKIPPING: test_pg_import - PG import not implemented 2026-02-24T16:10:11.003 INFO:tasks.ceph_objectstore_tool:Restarting OSDs.... 2026-02-24T16:10:11.003 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-24T16:10:11.079 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:11.074+0000 7fb1085a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:11.081 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:11.079+0000 7fb1085a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:11.192 INFO:teuthology.orchestra.run.trial053.stdout:epoch 22 2026-02-24T16:10:11.192 INFO:teuthology.orchestra.run.trial053.stdout:fsid 6abeadec-6aab-4afb-8494-572099c2e04c 2026-02-24T16:10:11.192 INFO:teuthology.orchestra.run.trial053.stdout:created 2026-02-24T16:08:46.808406+0000 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:modified 2026-02-24T16:09:13.422070+0000 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:flags nodown,noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:crush_version 5 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:full_ratio 0.95 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:backfillfull_ratio 0.9 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:nearfull_ratio 0.85 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:require_min_compat_client luminous 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:min_compat_client jewel 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:require_osd_release tentacle 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:stretch_mode_enabled false 2026-02-24T16:10:11.193 INFO:teuthology.orchestra.run.trial053.stdout:allow_crimson=true 2026-02-24T16:10:11.194 INFO:teuthology.orchestra.run.trial053.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-24T16:10:11.194 INFO:teuthology.orchestra.run.trial053.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-24T16:10:11.194 INFO:teuthology.orchestra.run.trial053.stdout: removed_snaps_queue [2~1] 2026-02-24T16:10:11.194 INFO:teuthology.orchestra.run.trial053.stdout:pool 3 'rep_pool' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,crimson stripe_width 0 read_balance_score 1.50 2026-02-24T16:10:11.194 INFO:teuthology.orchestra.run.trial053.stdout:max_osd 4 2026-02-24T16:10:11.194 INFO:teuthology.orchestra.run.trial053.stdout:osd.0 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599 2026-02-24T16:10:11.194 INFO:teuthology.orchestra.run.trial053.stdout:osd.1 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd 2026-02-24T16:10:11.194 INFO:teuthology.orchestra.run.trial053.stdout:osd.2 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94 2026-02-24T16:10:11.194 INFO:teuthology.orchestra.run.trial053.stdout:osd.3 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9 2026-02-24T16:10:11.201 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6806/360737695 v2:10.20.193.53:6807/360737695 exists,up dba280e4-1777-43ce-8051-4b7a6cefe599', 'osd.1 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6802/821453193 v2:10.20.193.53:6805/821453193 exists,up 1b6eb159-3f62-4730-8d91-940c1dd852dd', 'osd.2 up in weight 1 up_from 11 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6813/1170288352 v2:10.20.193.53:6812/1170288352 exists,up f00a93d9-2c45-428b-98de-89b05ea2ee94', 'osd.3 up in weight 1 up_from 10 up_thru 20 down_at 0 last_clean_interval [0,0) v2:10.20.193.53:6804/3103081419 v2:10.20.193.53:6803/3103081419 exists,up 5526503d-de9b-4bf8-b9a0-a31f664936c9'] 2026-02-24T16:10:11.201 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-24T16:10:11.202 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-24T16:10:11.204 INFO:tasks.ceph.osd.0:Started 2026-02-24T16:10:11.204 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-24T16:10:11.275 INFO:teuthology.orchestra.run.trial053.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-24T16:10:11.278 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T16:10:11.279 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2026-02-24T16:10:16.280 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2026-02-24T16:10:16.847 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:16.848 INFO:teuthology.orchestra.run.trial053.stdout: "ops_in_flight": [] 2026-02-24T16:10:16.848 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:16.855 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-24T16:10:16.855 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-24T16:10:16.858 INFO:tasks.ceph.osd.1:Started 2026-02-24T16:10:16.858 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-24T16:10:16.932 INFO:teuthology.orchestra.run.trial053.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-24T16:10:16.934 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T16:10:16.935 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2026-02-24T16:10:21.936 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2026-02-24T16:10:22.860 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:22.860 INFO:teuthology.orchestra.run.trial053.stdout: "ops_in_flight": [] 2026-02-24T16:10:22.860 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:22.871 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-24T16:10:22.871 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-24T16:10:22.874 INFO:tasks.ceph.osd.2:Started 2026-02-24T16:10:22.874 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-24T16:10:22.948 INFO:teuthology.orchestra.run.trial053.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-24T16:10:22.951 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T16:10:22.952 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-24T16:10:27.953 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-24T16:10:28.884 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:28.884 INFO:teuthology.orchestra.run.trial053.stdout: "ops_in_flight": [] 2026-02-24T16:10:28.884 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:28.895 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-24T16:10:28.895 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-24T16:10:28.898 INFO:tasks.ceph.osd.3:Started 2026-02-24T16:10:28.898 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-24T16:10:28.975 INFO:teuthology.orchestra.run.trial053.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-24T16:10:28.978 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-24T16:10:28.978 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-24T16:10:33.979 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-24T16:10:34.900 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:34.900 INFO:teuthology.orchestra.run.trial053.stdout: "ops_in_flight": [] 2026-02-24T16:10:34.901 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:39.915 INFO:tasks.ceph_objectstore_tool:Verify replicated import data 2026-02-24T16:10:39.916 INFO:tasks.util.rados:rados -p rep_pool get REPobject1 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:39.916 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject1 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:39.956 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:39.953+0000 7f4209032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:39.959 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:39.957+0000 7f4209032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:39.959 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:39.957+0000 7f4209032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:39.974 DEBUG:teuthology.orchestra.run.trial053:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject1 2026-02-24T16:10:40.031 INFO:tasks.util.rados:rados -p rep_pool get REPobject2 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:40.031 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject2 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:40.110 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.108+0000 7fc395e8bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.113 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.111+0000 7fc395e8bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.114 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.111+0000 7fc395e8bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.130 DEBUG:teuthology.orchestra.run.trial053:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject2 2026-02-24T16:10:40.187 INFO:tasks.util.rados:rados -p rep_pool get REPobject3 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:40.187 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject3 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:40.265 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.263+0000 7f3a2e881ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.268 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.266+0000 7f3a2e881ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.268 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.266+0000 7f3a2e881ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.284 DEBUG:teuthology.orchestra.run.trial053:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject3 2026-02-24T16:10:40.341 INFO:tasks.util.rados:rados -p rep_pool get REPobject4 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:40.341 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject4 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:40.419 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.417+0000 7f3fcba45ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.423 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.420+0000 7f3fcba45ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.423 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.420+0000 7f3fcba45ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.438 DEBUG:teuthology.orchestra.run.trial053:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject4 2026-02-24T16:10:40.495 INFO:tasks.util.rados:rados -p rep_pool get REPobject5 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:40.496 DEBUG:teuthology.orchestra.run.trial053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados -p rep_pool get REPobject5 /home/ubuntu/cephtest/ceph.data/gettest 2026-02-24T16:10:40.573 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.571+0000 7fd6230daec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.576 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.574+0000 7fd6230daec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.576 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.574+0000 7fd6230daec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.593 DEBUG:teuthology.orchestra.run.trial053:> diff -q /home/ubuntu/cephtest/ceph.data/gettest /home/ubuntu/cephtest/ceph.data/REPobject5 2026-02-24T16:10:40.650 INFO:tasks.ceph_objectstore_tool:SKIPPING EC pool tests for crimson-objectstore-tool 2026-02-24T16:10:40.650 INFO:tasks.ceph_objectstore_tool:TEST PASSED 2026-02-24T16:10:40.650 DEBUG:teuthology.run_tasks:Unwinding manager ceph_objectstore_tool 2026-02-24T16:10:40.678 INFO:tasks.ceph_objectstore_tool:Ending ceph_objectstore_tool 2026-02-24T16:10:40.678 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-24T16:10:40.694 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T16:10:40.694 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T16:10:40.771 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.766+0000 7fc34a68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.773 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.771+0000 7fc34a68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.884 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:10:40.884 INFO:teuthology.orchestra.run.trial053.stderr:dumped all 2026-02-24T16:10:40.894 INFO:teuthology.orchestra.run.trial053.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2026-02-24T16:10:39.060474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7920,"kb_used_data":7920,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182992,"statfs":{"total":214211493888,"available":214203383808,"internally_reserved":0,"allocated":8110080,"data_stored":8110080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000810"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.897468+0000","last_change":"2026-02-24T16:10:23.891021+0000","last_active":"2026-02-24T16:10:35.897468+0000","last_peered":"2026-02-24T16:10:35.897468+0000","last_clean":"2026-02-24T16:10:35.897468+0000","last_became_active":"2026-02-24T16:10:23.882064+0000","last_became_peered":"2026-02-24T16:10:23.882064+0000","last_unstale":"2026-02-24T16:10:35.897468+0000","last_undegraded":"2026-02-24T16:10:35.897468+0000","last_fullsized":"2026-02-24T16:10:35.897468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_clean_scrub_stamp":"2026-02-24T16:09:01.383612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.948889+0000","last_change":"2026-02-24T16:10:35.949615+0000","last_active":"2026-02-24T16:10:35.948889+0000","last_peered":"2026-02-24T16:10:35.948889+0000","last_clean":"2026-02-24T16:09:04.462486+0000","last_became_active":"2026-02-24T16:10:35.930577+0000","last_became_peered":"2026-02-24T16:10:35.930577+0000","last_unstale":"2026-02-24T16:10:35.948889+0000","last_undegraded":"2026-02-24T16:10:35.948889+0000","last_fullsized":"2026-02-24T16:10:35.948889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.941372+0000","last_change":"2026-02-24T16:10:35.942062+0000","last_active":"2026-02-24T16:10:35.941372+0000","last_peered":"2026-02-24T16:10:35.941372+0000","last_clean":"2026-02-24T16:09:13.497663+0000","last_became_active":"2026-02-24T16:10:35.924577+0000","last_became_peered":"2026-02-24T16:10:35.924577+0000","last_unstale":"2026-02-24T16:10:35.941372+0000","last_undegraded":"2026-02-24T16:10:35.941372+0000","last_fullsized":"2026-02-24T16:10:35.941372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.943579+0000","last_change":"2026-02-24T16:10:35.944152+0000","last_active":"2026-02-24T16:10:35.943579+0000","last_peered":"2026-02-24T16:10:35.943579+0000","last_clean":"2026-02-24T16:09:04.447967+0000","last_became_active":"2026-02-24T16:10:35.926938+0000","last_became_peered":"2026-02-24T16:10:35.926938+0000","last_unstale":"2026-02-24T16:10:35.943579+0000","last_undegraded":"2026-02-24T16:10:35.943579+0000","last_fullsized":"2026-02-24T16:10:35.943579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T16:10:34.895975+0000","last_change":"2026-02-24T16:10:29.910183+0000","last_active":"2026-02-24T16:10:34.895975+0000","last_peered":"2026-02-24T16:10:34.895975+0000","last_clean":"2026-02-24T16:10:34.895975+0000","last_became_active":"2026-02-24T16:10:29.905441+0000","last_became_peered":"2026-02-24T16:10:29.905441+0000","last_unstale":"2026-02-24T16:10:34.895975+0000","last_undegraded":"2026-02-24T16:10:34.895975+0000","last_fullsized":"2026-02-24T16:10:34.895975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.955825+0000","last_change":"2026-02-24T16:10:35.956402+0000","last_active":"2026-02-24T16:10:35.955825+0000","last_peered":"2026-02-24T16:10:35.955825+0000","last_clean":"2026-02-24T16:09:04.453931+0000","last_became_active":"2026-02-24T16:10:35.941819+0000","last_became_peered":"2026-02-24T16:10:35.941819+0000","last_unstale":"2026-02-24T16:10:35.955825+0000","last_undegraded":"2026-02-24T16:10:35.955825+0000","last_fullsized":"2026-02-24T16:10:35.955825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898989+0000","last_change":"2026-02-24T16:10:29.909023+0000","last_active":"2026-02-24T16:10:35.898989+0000","last_peered":"2026-02-24T16:10:35.898989+0000","last_clean":"2026-02-24T16:10:35.898989+0000","last_became_active":"2026-02-24T16:10:29.904319+0000","last_became_peered":"2026-02-24T16:10:29.904319+0000","last_unstale":"2026-02-24T16:10:35.898989+0000","last_undegraded":"2026-02-24T16:10:35.898989+0000","last_fullsized":"2026-02-24T16:10:35.898989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.939552+0000","last_change":"2026-02-24T16:10:35.939893+0000","last_active":"2026-02-24T16:10:35.939552+0000","last_peered":"2026-02-24T16:10:35.939552+0000","last_clean":"2026-02-24T16:09:06.422842+0000","last_became_active":"2026-02-24T16:10:35.925533+0000","last_became_peered":"2026-02-24T16:10:35.925533+0000","last_unstale":"2026-02-24T16:10:35.939552+0000","last_undegraded":"2026-02-24T16:10:35.939552+0000","last_fullsized":"2026-02-24T16:10:35.939552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T16:10:34.895611+0000","last_change":"2026-02-24T16:10:29.910363+0000","last_active":"2026-02-24T16:10:34.895611+0000","last_peered":"2026-02-24T16:10:34.895611+0000","last_clean":"2026-02-24T16:10:34.895611+0000","last_became_active":"2026-02-24T16:10:29.901363+0000","last_became_peered":"2026-02-24T16:10:29.901363+0000","last_unstale":"2026-02-24T16:10:34.895611+0000","last_undegraded":"2026-02-24T16:10:34.895611+0000","last_fullsized":"2026-02-24T16:10:34.895611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.952215+0000","last_change":"2026-02-24T16:10:35.952734+0000","last_active":"2026-02-24T16:10:35.952215+0000","last_peered":"2026-02-24T16:10:35.952215+0000","last_clean":"2026-02-24T16:09:15.283200+0000","last_became_active":"2026-02-24T16:10:35.947804+0000","last_became_peered":"2026-02-24T16:10:35.947804+0000","last_unstale":"2026-02-24T16:10:35.952215+0000","last_undegraded":"2026-02-24T16:10:35.952215+0000","last_fullsized":"2026-02-24T16:10:35.952215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898599+0000","last_change":"2026-02-24T16:10:26.872935+0000","last_active":"2026-02-24T16:10:35.898599+0000","last_peered":"2026-02-24T16:10:35.898599+0000","last_clean":"2026-02-24T16:10:35.898599+0000","last_became_active":"2026-02-24T16:10:23.890545+0000","last_became_peered":"2026-02-24T16:10:23.890545+0000","last_unstale":"2026-02-24T16:10:35.898599+0000","last_undegraded":"2026-02-24T16:10:35.898599+0000","last_fullsized":"2026-02-24T16:10:35.898599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.896208+0000","last_change":"2026-02-24T16:10:29.910589+0000","last_active":"2026-02-24T16:10:35.896208+0000","last_peered":"2026-02-24T16:10:35.896208+0000","last_clean":"2026-02-24T16:10:35.896208+0000","last_became_active":"2026-02-24T16:10:29.900921+0000","last_became_peered":"2026-02-24T16:10:29.900921+0000","last_unstale":"2026-02-24T16:10:35.896208+0000","last_undegraded":"2026-02-24T16:10:35.896208+0000","last_fullsized":"2026-02-24T16:10:35.896208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.942166+0000","last_change":"2026-02-24T16:10:35.942497+0000","last_active":"2026-02-24T16:10:35.942166+0000","last_peered":"2026-02-24T16:10:35.942166+0000","last_clean":"2026-02-24T16:09:04.451125+0000","last_became_active":"2026-02-24T16:10:35.927513+0000","last_became_peered":"2026-02-24T16:10:35.927513+0000","last_unstale":"2026-02-24T16:10:35.942166+0000","last_undegraded":"2026-02-24T16:10:35.942166+0000","last_fullsized":"2026-02-24T16:10:35.942166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.944330+0000","last_change":"2026-02-24T16:10:35.944770+0000","last_active":"2026-02-24T16:10:35.944330+0000","last_peered":"2026-02-24T16:10:35.944330+0000","last_clean":"2026-02-24T16:09:12.473911+0000","last_became_active":"2026-02-24T16:10:35.932060+0000","last_became_peered":"2026-02-24T16:10:35.932060+0000","last_unstale":"2026-02-24T16:10:35.944330+0000","last_undegraded":"2026-02-24T16:10:35.944330+0000","last_fullsized":"2026-02-24T16:10:35.944330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898533+0000","last_change":"2026-02-24T16:10:26.873129+0000","last_active":"2026-02-24T16:10:35.898533+0000","last_peered":"2026-02-24T16:10:35.898533+0000","last_clean":"2026-02-24T16:10:35.898533+0000","last_became_active":"2026-02-24T16:10:23.884785+0000","last_became_peered":"2026-02-24T16:10:23.884785+0000","last_unstale":"2026-02-24T16:10:35.898533+0000","last_undegraded":"2026-02-24T16:10:35.898533+0000","last_fullsized":"2026-02-24T16:10:35.898533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2026-02-24T16:10:34.895375+0000","last_change":"2026-02-24T16:10:23.889332+0000","last_active":"2026-02-24T16:10:34.895375+0000","last_peered":"2026-02-24T16:10:34.895375+0000","last_clean":"2026-02-24T16:10:34.895375+0000","last_became_active":"2026-02-24T16:10:23.882812+0000","last_became_peered":"2026-02-24T16:10:23.882812+0000","last_unstale":"2026-02-24T16:10:34.895375+0000","last_undegraded":"2026-02-24T16:10:34.895375+0000","last_fullsized":"2026-02-24T16:10:34.895375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.940902+0000","last_change":"2026-02-24T16:10:35.941600+0000","last_active":"2026-02-24T16:10:35.940902+0000","last_peered":"2026-02-24T16:10:35.940902+0000","last_clean":"2026-02-24T16:09:04.472771+0000","last_became_active":"2026-02-24T16:10:35.927161+0000","last_became_peered":"2026-02-24T16:10:35.927161+0000","last_unstale":"2026-02-24T16:10:35.940902+0000","last_undegraded":"2026-02-24T16:10:35.940902+0000","last_fullsized":"2026-02-24T16:10:35.940902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203351040,"internally_reserved":0,"allocated":8142848,"data_stored":8142848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":37,"seq":158913789956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":33,"seq":141733920777,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295224,"statfs":{"total":53552873472,"available":53550309376,"internally_reserved":0,"allocated":2564096,"data_stored":2564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182418,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1700,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296028,"statfs":{"total":53552873472,"available":53551132672,"internally_reserved":0,"allocated":1740800,"data_stored":1740800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551108096,"internally_reserved":0,"allocated":1765376,"data_stored":1765376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T16:10:40.896 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T16:10:40.973 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.969+0000 7fdcd5d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:40.975 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:40.973+0000 7fdcd5d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:41.085 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:10:41.085 INFO:teuthology.orchestra.run.trial053.stderr:dumped all 2026-02-24T16:10:41.094 INFO:teuthology.orchestra.run.trial053.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2026-02-24T16:10:41.060721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":359,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7952,"kb_used_data":7952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182960,"statfs":{"total":214211493888,"available":214203351040,"internally_reserved":0,"allocated":8142848,"data_stored":8142848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.181455"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.897468+0000","last_change":"2026-02-24T16:10:23.891021+0000","last_active":"2026-02-24T16:10:35.897468+0000","last_peered":"2026-02-24T16:10:35.897468+0000","last_clean":"2026-02-24T16:10:35.897468+0000","last_became_active":"2026-02-24T16:10:23.882064+0000","last_became_peered":"2026-02-24T16:10:23.882064+0000","last_unstale":"2026-02-24T16:10:35.897468+0000","last_undegraded":"2026-02-24T16:10:35.897468+0000","last_fullsized":"2026-02-24T16:10:35.897468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_clean_scrub_stamp":"2026-02-24T16:09:01.383612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.948889+0000","last_change":"2026-02-24T16:10:35.949615+0000","last_active":"2026-02-24T16:10:35.948889+0000","last_peered":"2026-02-24T16:10:35.948889+0000","last_clean":"2026-02-24T16:09:04.462486+0000","last_became_active":"2026-02-24T16:10:35.930577+0000","last_became_peered":"2026-02-24T16:10:35.930577+0000","last_unstale":"2026-02-24T16:10:35.948889+0000","last_undegraded":"2026-02-24T16:10:35.948889+0000","last_fullsized":"2026-02-24T16:10:35.948889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.941372+0000","last_change":"2026-02-24T16:10:35.942062+0000","last_active":"2026-02-24T16:10:35.941372+0000","last_peered":"2026-02-24T16:10:35.941372+0000","last_clean":"2026-02-24T16:09:13.497663+0000","last_became_active":"2026-02-24T16:10:35.924577+0000","last_became_peered":"2026-02-24T16:10:35.924577+0000","last_unstale":"2026-02-24T16:10:35.941372+0000","last_undegraded":"2026-02-24T16:10:35.941372+0000","last_fullsized":"2026-02-24T16:10:35.941372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.943579+0000","last_change":"2026-02-24T16:10:35.944152+0000","last_active":"2026-02-24T16:10:35.943579+0000","last_peered":"2026-02-24T16:10:35.943579+0000","last_clean":"2026-02-24T16:09:04.447967+0000","last_became_active":"2026-02-24T16:10:35.926938+0000","last_became_peered":"2026-02-24T16:10:35.926938+0000","last_unstale":"2026-02-24T16:10:35.943579+0000","last_undegraded":"2026-02-24T16:10:35.943579+0000","last_fullsized":"2026-02-24T16:10:35.943579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898272+0000","last_change":"2026-02-24T16:10:29.910183+0000","last_active":"2026-02-24T16:10:35.898272+0000","last_peered":"2026-02-24T16:10:35.898272+0000","last_clean":"2026-02-24T16:10:35.898272+0000","last_became_active":"2026-02-24T16:10:29.905441+0000","last_became_peered":"2026-02-24T16:10:29.905441+0000","last_unstale":"2026-02-24T16:10:35.898272+0000","last_undegraded":"2026-02-24T16:10:35.898272+0000","last_fullsized":"2026-02-24T16:10:35.898272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.955825+0000","last_change":"2026-02-24T16:10:35.956402+0000","last_active":"2026-02-24T16:10:35.955825+0000","last_peered":"2026-02-24T16:10:35.955825+0000","last_clean":"2026-02-24T16:09:04.453931+0000","last_became_active":"2026-02-24T16:10:35.941819+0000","last_became_peered":"2026-02-24T16:10:35.941819+0000","last_unstale":"2026-02-24T16:10:35.955825+0000","last_undegraded":"2026-02-24T16:10:35.955825+0000","last_fullsized":"2026-02-24T16:10:35.955825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898989+0000","last_change":"2026-02-24T16:10:29.909023+0000","last_active":"2026-02-24T16:10:35.898989+0000","last_peered":"2026-02-24T16:10:35.898989+0000","last_clean":"2026-02-24T16:10:35.898989+0000","last_became_active":"2026-02-24T16:10:29.904319+0000","last_became_peered":"2026-02-24T16:10:29.904319+0000","last_unstale":"2026-02-24T16:10:35.898989+0000","last_undegraded":"2026-02-24T16:10:35.898989+0000","last_fullsized":"2026-02-24T16:10:35.898989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.939552+0000","last_change":"2026-02-24T16:10:35.939893+0000","last_active":"2026-02-24T16:10:35.939552+0000","last_peered":"2026-02-24T16:10:35.939552+0000","last_clean":"2026-02-24T16:09:06.422842+0000","last_became_active":"2026-02-24T16:10:35.925533+0000","last_became_peered":"2026-02-24T16:10:35.925533+0000","last_unstale":"2026-02-24T16:10:35.939552+0000","last_undegraded":"2026-02-24T16:10:35.939552+0000","last_fullsized":"2026-02-24T16:10:35.939552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.896486+0000","last_change":"2026-02-24T16:10:29.910363+0000","last_active":"2026-02-24T16:10:35.896486+0000","last_peered":"2026-02-24T16:10:35.896486+0000","last_clean":"2026-02-24T16:10:35.896486+0000","last_became_active":"2026-02-24T16:10:29.901363+0000","last_became_peered":"2026-02-24T16:10:29.901363+0000","last_unstale":"2026-02-24T16:10:35.896486+0000","last_undegraded":"2026-02-24T16:10:35.896486+0000","last_fullsized":"2026-02-24T16:10:35.896486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.952215+0000","last_change":"2026-02-24T16:10:35.952734+0000","last_active":"2026-02-24T16:10:35.952215+0000","last_peered":"2026-02-24T16:10:35.952215+0000","last_clean":"2026-02-24T16:09:15.283200+0000","last_became_active":"2026-02-24T16:10:35.947804+0000","last_became_peered":"2026-02-24T16:10:35.947804+0000","last_unstale":"2026-02-24T16:10:35.952215+0000","last_undegraded":"2026-02-24T16:10:35.952215+0000","last_fullsized":"2026-02-24T16:10:35.952215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898599+0000","last_change":"2026-02-24T16:10:26.872935+0000","last_active":"2026-02-24T16:10:35.898599+0000","last_peered":"2026-02-24T16:10:35.898599+0000","last_clean":"2026-02-24T16:10:35.898599+0000","last_became_active":"2026-02-24T16:10:23.890545+0000","last_became_peered":"2026-02-24T16:10:23.890545+0000","last_unstale":"2026-02-24T16:10:35.898599+0000","last_undegraded":"2026-02-24T16:10:35.898599+0000","last_fullsized":"2026-02-24T16:10:35.898599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.896208+0000","last_change":"2026-02-24T16:10:29.910589+0000","last_active":"2026-02-24T16:10:35.896208+0000","last_peered":"2026-02-24T16:10:35.896208+0000","last_clean":"2026-02-24T16:10:35.896208+0000","last_became_active":"2026-02-24T16:10:29.900921+0000","last_became_peered":"2026-02-24T16:10:29.900921+0000","last_unstale":"2026-02-24T16:10:35.896208+0000","last_undegraded":"2026-02-24T16:10:35.896208+0000","last_fullsized":"2026-02-24T16:10:35.896208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.942166+0000","last_change":"2026-02-24T16:10:35.942497+0000","last_active":"2026-02-24T16:10:35.942166+0000","last_peered":"2026-02-24T16:10:35.942166+0000","last_clean":"2026-02-24T16:09:04.451125+0000","last_became_active":"2026-02-24T16:10:35.927513+0000","last_became_peered":"2026-02-24T16:10:35.927513+0000","last_unstale":"2026-02-24T16:10:35.942166+0000","last_undegraded":"2026-02-24T16:10:35.942166+0000","last_fullsized":"2026-02-24T16:10:35.942166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.944330+0000","last_change":"2026-02-24T16:10:35.944770+0000","last_active":"2026-02-24T16:10:35.944330+0000","last_peered":"2026-02-24T16:10:35.944330+0000","last_clean":"2026-02-24T16:09:12.473911+0000","last_became_active":"2026-02-24T16:10:35.932060+0000","last_became_peered":"2026-02-24T16:10:35.932060+0000","last_unstale":"2026-02-24T16:10:35.944330+0000","last_undegraded":"2026-02-24T16:10:35.944330+0000","last_fullsized":"2026-02-24T16:10:35.944330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898533+0000","last_change":"2026-02-24T16:10:26.873129+0000","last_active":"2026-02-24T16:10:35.898533+0000","last_peered":"2026-02-24T16:10:35.898533+0000","last_clean":"2026-02-24T16:10:35.898533+0000","last_became_active":"2026-02-24T16:10:23.884785+0000","last_became_peered":"2026-02-24T16:10:23.884785+0000","last_unstale":"2026-02-24T16:10:35.898533+0000","last_undegraded":"2026-02-24T16:10:35.898533+0000","last_fullsized":"2026-02-24T16:10:35.898533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898780+0000","last_change":"2026-02-24T16:10:23.889332+0000","last_active":"2026-02-24T16:10:35.898780+0000","last_peered":"2026-02-24T16:10:35.898780+0000","last_clean":"2026-02-24T16:10:35.898780+0000","last_became_active":"2026-02-24T16:10:23.882812+0000","last_became_peered":"2026-02-24T16:10:23.882812+0000","last_unstale":"2026-02-24T16:10:35.898780+0000","last_undegraded":"2026-02-24T16:10:35.898780+0000","last_fullsized":"2026-02-24T16:10:35.898780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.940902+0000","last_change":"2026-02-24T16:10:35.941600+0000","last_active":"2026-02-24T16:10:35.940902+0000","last_peered":"2026-02-24T16:10:35.940902+0000","last_clean":"2026-02-24T16:09:04.472771+0000","last_became_active":"2026-02-24T16:10:35.927161+0000","last_became_peered":"2026-02-24T16:10:35.927161+0000","last_unstale":"2026-02-24T16:10:35.940902+0000","last_undegraded":"2026-02-24T16:10:35.940902+0000","last_fullsized":"2026-02-24T16:10:35.940902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":37,"seq":158913789956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":33,"seq":141733920777,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295224,"statfs":{"total":53552873472,"available":53550309376,"internally_reserved":0,"allocated":2564096,"data_stored":2564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182423,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1732,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295996,"statfs":{"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T16:10:41.095 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T16:10:41.096 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T16:10:41.172 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:41.168+0000 7f36a14cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:41.175 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:41.172+0000 7f36a14cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:41.289 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:10:41.289 INFO:teuthology.orchestra.run.trial053.stderr:dumped all 2026-02-24T16:10:41.298 INFO:teuthology.orchestra.run.trial053.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2026-02-24T16:10:41.060721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":359,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7952,"kb_used_data":7952,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182960,"statfs":{"total":214211493888,"available":214203351040,"internally_reserved":0,"allocated":8142848,"data_stored":8142848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.181455"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.897468+0000","last_change":"2026-02-24T16:10:23.891021+0000","last_active":"2026-02-24T16:10:35.897468+0000","last_peered":"2026-02-24T16:10:35.897468+0000","last_clean":"2026-02-24T16:10:35.897468+0000","last_became_active":"2026-02-24T16:10:23.882064+0000","last_became_peered":"2026-02-24T16:10:23.882064+0000","last_unstale":"2026-02-24T16:10:35.897468+0000","last_undegraded":"2026-02-24T16:10:35.897468+0000","last_fullsized":"2026-02-24T16:10:35.897468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_clean_scrub_stamp":"2026-02-24T16:09:01.383612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.948889+0000","last_change":"2026-02-24T16:10:35.949615+0000","last_active":"2026-02-24T16:10:35.948889+0000","last_peered":"2026-02-24T16:10:35.948889+0000","last_clean":"2026-02-24T16:09:04.462486+0000","last_became_active":"2026-02-24T16:10:35.930577+0000","last_became_peered":"2026-02-24T16:10:35.930577+0000","last_unstale":"2026-02-24T16:10:35.948889+0000","last_undegraded":"2026-02-24T16:10:35.948889+0000","last_fullsized":"2026-02-24T16:10:35.948889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.941372+0000","last_change":"2026-02-24T16:10:35.942062+0000","last_active":"2026-02-24T16:10:35.941372+0000","last_peered":"2026-02-24T16:10:35.941372+0000","last_clean":"2026-02-24T16:09:13.497663+0000","last_became_active":"2026-02-24T16:10:35.924577+0000","last_became_peered":"2026-02-24T16:10:35.924577+0000","last_unstale":"2026-02-24T16:10:35.941372+0000","last_undegraded":"2026-02-24T16:10:35.941372+0000","last_fullsized":"2026-02-24T16:10:35.941372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.943579+0000","last_change":"2026-02-24T16:10:35.944152+0000","last_active":"2026-02-24T16:10:35.943579+0000","last_peered":"2026-02-24T16:10:35.943579+0000","last_clean":"2026-02-24T16:09:04.447967+0000","last_became_active":"2026-02-24T16:10:35.926938+0000","last_became_peered":"2026-02-24T16:10:35.926938+0000","last_unstale":"2026-02-24T16:10:35.943579+0000","last_undegraded":"2026-02-24T16:10:35.943579+0000","last_fullsized":"2026-02-24T16:10:35.943579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898272+0000","last_change":"2026-02-24T16:10:29.910183+0000","last_active":"2026-02-24T16:10:35.898272+0000","last_peered":"2026-02-24T16:10:35.898272+0000","last_clean":"2026-02-24T16:10:35.898272+0000","last_became_active":"2026-02-24T16:10:29.905441+0000","last_became_peered":"2026-02-24T16:10:29.905441+0000","last_unstale":"2026-02-24T16:10:35.898272+0000","last_undegraded":"2026-02-24T16:10:35.898272+0000","last_fullsized":"2026-02-24T16:10:35.898272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.955825+0000","last_change":"2026-02-24T16:10:35.956402+0000","last_active":"2026-02-24T16:10:35.955825+0000","last_peered":"2026-02-24T16:10:35.955825+0000","last_clean":"2026-02-24T16:09:04.453931+0000","last_became_active":"2026-02-24T16:10:35.941819+0000","last_became_peered":"2026-02-24T16:10:35.941819+0000","last_unstale":"2026-02-24T16:10:35.955825+0000","last_undegraded":"2026-02-24T16:10:35.955825+0000","last_fullsized":"2026-02-24T16:10:35.955825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898989+0000","last_change":"2026-02-24T16:10:29.909023+0000","last_active":"2026-02-24T16:10:35.898989+0000","last_peered":"2026-02-24T16:10:35.898989+0000","last_clean":"2026-02-24T16:10:35.898989+0000","last_became_active":"2026-02-24T16:10:29.904319+0000","last_became_peered":"2026-02-24T16:10:29.904319+0000","last_unstale":"2026-02-24T16:10:35.898989+0000","last_undegraded":"2026-02-24T16:10:35.898989+0000","last_fullsized":"2026-02-24T16:10:35.898989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.939552+0000","last_change":"2026-02-24T16:10:35.939893+0000","last_active":"2026-02-24T16:10:35.939552+0000","last_peered":"2026-02-24T16:10:35.939552+0000","last_clean":"2026-02-24T16:09:06.422842+0000","last_became_active":"2026-02-24T16:10:35.925533+0000","last_became_peered":"2026-02-24T16:10:35.925533+0000","last_unstale":"2026-02-24T16:10:35.939552+0000","last_undegraded":"2026-02-24T16:10:35.939552+0000","last_fullsized":"2026-02-24T16:10:35.939552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.896486+0000","last_change":"2026-02-24T16:10:29.910363+0000","last_active":"2026-02-24T16:10:35.896486+0000","last_peered":"2026-02-24T16:10:35.896486+0000","last_clean":"2026-02-24T16:10:35.896486+0000","last_became_active":"2026-02-24T16:10:29.901363+0000","last_became_peered":"2026-02-24T16:10:29.901363+0000","last_unstale":"2026-02-24T16:10:35.896486+0000","last_undegraded":"2026-02-24T16:10:35.896486+0000","last_fullsized":"2026-02-24T16:10:35.896486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.952215+0000","last_change":"2026-02-24T16:10:35.952734+0000","last_active":"2026-02-24T16:10:35.952215+0000","last_peered":"2026-02-24T16:10:35.952215+0000","last_clean":"2026-02-24T16:09:15.283200+0000","last_became_active":"2026-02-24T16:10:35.947804+0000","last_became_peered":"2026-02-24T16:10:35.947804+0000","last_unstale":"2026-02-24T16:10:35.952215+0000","last_undegraded":"2026-02-24T16:10:35.952215+0000","last_fullsized":"2026-02-24T16:10:35.952215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898599+0000","last_change":"2026-02-24T16:10:26.872935+0000","last_active":"2026-02-24T16:10:35.898599+0000","last_peered":"2026-02-24T16:10:35.898599+0000","last_clean":"2026-02-24T16:10:35.898599+0000","last_became_active":"2026-02-24T16:10:23.890545+0000","last_became_peered":"2026-02-24T16:10:23.890545+0000","last_unstale":"2026-02-24T16:10:35.898599+0000","last_undegraded":"2026-02-24T16:10:35.898599+0000","last_fullsized":"2026-02-24T16:10:35.898599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.896208+0000","last_change":"2026-02-24T16:10:29.910589+0000","last_active":"2026-02-24T16:10:35.896208+0000","last_peered":"2026-02-24T16:10:35.896208+0000","last_clean":"2026-02-24T16:10:35.896208+0000","last_became_active":"2026-02-24T16:10:29.900921+0000","last_became_peered":"2026-02-24T16:10:29.900921+0000","last_unstale":"2026-02-24T16:10:35.896208+0000","last_undegraded":"2026-02-24T16:10:35.896208+0000","last_fullsized":"2026-02-24T16:10:35.896208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.942166+0000","last_change":"2026-02-24T16:10:35.942497+0000","last_active":"2026-02-24T16:10:35.942166+0000","last_peered":"2026-02-24T16:10:35.942166+0000","last_clean":"2026-02-24T16:09:04.451125+0000","last_became_active":"2026-02-24T16:10:35.927513+0000","last_became_peered":"2026-02-24T16:10:35.927513+0000","last_unstale":"2026-02-24T16:10:35.942166+0000","last_undegraded":"2026-02-24T16:10:35.942166+0000","last_fullsized":"2026-02-24T16:10:35.942166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.944330+0000","last_change":"2026-02-24T16:10:35.944770+0000","last_active":"2026-02-24T16:10:35.944330+0000","last_peered":"2026-02-24T16:10:35.944330+0000","last_clean":"2026-02-24T16:09:12.473911+0000","last_became_active":"2026-02-24T16:10:35.932060+0000","last_became_peered":"2026-02-24T16:10:35.932060+0000","last_unstale":"2026-02-24T16:10:35.944330+0000","last_undegraded":"2026-02-24T16:10:35.944330+0000","last_fullsized":"2026-02-24T16:10:35.944330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898533+0000","last_change":"2026-02-24T16:10:26.873129+0000","last_active":"2026-02-24T16:10:35.898533+0000","last_peered":"2026-02-24T16:10:35.898533+0000","last_clean":"2026-02-24T16:10:35.898533+0000","last_became_active":"2026-02-24T16:10:23.884785+0000","last_became_peered":"2026-02-24T16:10:23.884785+0000","last_unstale":"2026-02-24T16:10:35.898533+0000","last_undegraded":"2026-02-24T16:10:35.898533+0000","last_fullsized":"2026-02-24T16:10:35.898533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898780+0000","last_change":"2026-02-24T16:10:23.889332+0000","last_active":"2026-02-24T16:10:35.898780+0000","last_peered":"2026-02-24T16:10:35.898780+0000","last_clean":"2026-02-24T16:10:35.898780+0000","last_became_active":"2026-02-24T16:10:23.882812+0000","last_became_peered":"2026-02-24T16:10:23.882812+0000","last_unstale":"2026-02-24T16:10:35.898780+0000","last_undegraded":"2026-02-24T16:10:35.898780+0000","last_fullsized":"2026-02-24T16:10:35.898780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.940902+0000","last_change":"2026-02-24T16:10:35.941600+0000","last_active":"2026-02-24T16:10:35.940902+0000","last_peered":"2026-02-24T16:10:35.940902+0000","last_clean":"2026-02-24T16:09:04.472771+0000","last_became_active":"2026-02-24T16:10:35.927161+0000","last_became_peered":"2026-02-24T16:10:35.927161+0000","last_unstale":"2026-02-24T16:10:35.940902+0000","last_undegraded":"2026-02-24T16:10:35.940902+0000","last_fullsized":"2026-02-24T16:10:35.940902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":37,"seq":158913789956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":33,"seq":141733920777,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051597,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2504,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295224,"statfs":{"total":53552873472,"available":53550309376,"internally_reserved":0,"allocated":2564096,"data_stored":2564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182423,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1732,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295996,"statfs":{"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T16:10:41.300 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T16:10:41.375 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:41.371+0000 7fa12f70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:41.378 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:41.375+0000 7fa12f70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:41.490 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:10:41.491 INFO:teuthology.orchestra.run.trial053.stdout:{"epoch":38,"fsid":"6abeadec-6aab-4afb-8494-572099c2e04c","created":"2026-02-24T16:08:46.808406+0000","modified":"2026-02-24T16:10:35.884237+0000","last_up_change":"2026-02-24T16:10:34.879043+0000","last_in_change":"2026-02-24T16:08:48.763462+0000","flags":"nodown,noout,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5800128,"flags_set":["nodown","noout","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":9,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T16:09:01.060550+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T16:09:03.115624+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"rep_pool","create_time":"2026-02-24T16:09:10.778838+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dba280e4-1777-43ce-8051-4b7a6cefe599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":22,"up_from":25,"up_thru":36,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6804","nonce":2814919194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6803","nonce":2814919194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6811","nonce":2814919194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6812","nonce":2814919194}]},"public_addr":"10.20.193.53:6804/2814919194","cluster_addr":"10.20.193.53:6803/2814919194","heartbeat_back_addr":"10.20.193.53:6811/2814919194","heartbeat_front_addr":"10.20.193.53:6812/2814919194","state":["exists","up"]},{"osd":1,"uuid":"1b6eb159-3f62-4730-8d91-940c1dd852dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":22,"up_from":29,"up_thru":36,"down_at":28,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6805","nonce":2600826050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6802","nonce":2600826050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6807","nonce":2600826050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6806","nonce":2600826050}]},"public_addr":"10.20.193.53:6805/2600826050","cluster_addr":"10.20.193.53:6802/2600826050","heartbeat_back_addr":"10.20.193.53:6807/2600826050","heartbeat_front_addr":"10.20.193.53:6806/2600826050","state":["exists","up"]},{"osd":2,"uuid":"f00a93d9-2c45-428b-98de-89b05ea2ee94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":11,"last_clean_end":22,"up_from":33,"up_thru":37,"down_at":32,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6809","nonce":709599934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6808","nonce":709599934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6818","nonce":709599934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6817","nonce":709599934}]},"public_addr":"10.20.193.53:6809/709599934","cluster_addr":"10.20.193.53:6808/709599934","heartbeat_back_addr":"10.20.193.53:6818/709599934","heartbeat_front_addr":"10.20.193.53:6817/709599934","state":["exists","up"]},{"osd":3,"uuid":"5526503d-de9b-4bf8-b9a0-a31f664936c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":10,"last_clean_end":22,"up_from":37,"up_thru":37,"down_at":36,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6810","nonce":735331007}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6813","nonce":735331007}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6814","nonce":735331007}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.53:6815","nonce":735331007}]},"public_addr":"10.20.193.53:6810/735331007","cluster_addr":"10.20.193.53:6813/735331007","heartbeat_back_addr":"10.20.193.53:6814/735331007","heartbeat_front_addr":"10.20.193.53:6815/735331007","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2026-02-24T16:10:15.831536+0000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"2026-02-24T16:10:21.841806+0000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2026-02-24T16:10:27.862268+0000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2026-02-24T16:10:33.876963+0000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T16:10:42.501 INFO:tasks.ceph:Scrubbing osd.0 2026-02-24T16:10:42.501 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-24T16:10:42.580 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:42.574+0000 7f3a5a10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:42.583 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:42.580+0000 7f3a5a10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:42.592 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:42.592 INFO:teuthology.orchestra.run.trial053.stdout: "success": "" 2026-02-24T16:10:42.592 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:42.601 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-24T16:10:42.680 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:42.676+0000 7f42c685a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:42.683 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:42.680+0000 7f42c685a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:42.794 INFO:teuthology.orchestra.run.trial053.stderr:instructed osd(s) 0 to deep-scrub 2026-02-24T16:10:42.805 INFO:tasks.ceph:Scrubbing osd.1 2026-02-24T16:10:42.805 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-24T16:10:42.885 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:42.878+0000 7f974861a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:42.887 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:42.885+0000 7f974861a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:42.896 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:42.896 INFO:teuthology.orchestra.run.trial053.stdout: "success": "" 2026-02-24T16:10:42.896 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:42.903 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-24T16:10:42.981 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:42.976+0000 7fcec43b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:42.983 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:42.981+0000 7fcec43b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.094 INFO:teuthology.orchestra.run.trial053.stderr:instructed osd(s) 1 to deep-scrub 2026-02-24T16:10:43.105 INFO:tasks.ceph:Scrubbing osd.2 2026-02-24T16:10:43.105 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-24T16:10:43.183 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.177+0000 7fcdbcec2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.185 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.183+0000 7fcdbcec2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.195 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:43.195 INFO:teuthology.orchestra.run.trial053.stdout: "success": "" 2026-02-24T16:10:43.195 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:43.202 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-24T16:10:43.278 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.274+0000 7fe04d85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.281 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.279+0000 7fe04d85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.391 INFO:teuthology.orchestra.run.trial053.stderr:instructed osd(s) 2 to deep-scrub 2026-02-24T16:10:43.402 INFO:tasks.ceph:Scrubbing osd.3 2026-02-24T16:10:43.402 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-24T16:10:43.481 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.474+0000 7f51b64c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.483 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.481+0000 7f51b64c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.493 INFO:teuthology.orchestra.run.trial053.stdout:{ 2026-02-24T16:10:43.493 INFO:teuthology.orchestra.run.trial053.stdout: "success": "" 2026-02-24T16:10:43.493 INFO:teuthology.orchestra.run.trial053.stdout:} 2026-02-24T16:10:43.500 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-24T16:10:43.578 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.573+0000 7fd4db9dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.580 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.578+0000 7fd4db9dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.692 INFO:teuthology.orchestra.run.trial053.stderr:instructed osd(s) 3 to deep-scrub 2026-02-24T16:10:43.702 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T16:10:43.778 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.774+0000 7faac0ba4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.780 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:10:43.778+0000 7faac0ba4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:10:43.889 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:10:43.890 INFO:teuthology.orchestra.run.trial053.stderr:dumped all 2026-02-24T16:10:43.898 INFO:teuthology.orchestra.run.trial053.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2026-02-24T16:10:43.060992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":1298,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7960,"kb_used_data":7960,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182952,"statfs":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1252,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.180648"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.897468+0000","last_change":"2026-02-24T16:10:23.891021+0000","last_active":"2026-02-24T16:10:35.897468+0000","last_peered":"2026-02-24T16:10:35.897468+0000","last_clean":"2026-02-24T16:10:35.897468+0000","last_became_active":"2026-02-24T16:10:23.882064+0000","last_became_peered":"2026-02-24T16:10:23.882064+0000","last_unstale":"2026-02-24T16:10:35.897468+0000","last_undegraded":"2026-02-24T16:10:35.897468+0000","last_fullsized":"2026-02-24T16:10:35.897468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:01.383612+0000","last_clean_scrub_stamp":"2026-02-24T16:09:01.383612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.948889+0000","last_change":"2026-02-24T16:10:35.949615+0000","last_active":"2026-02-24T16:10:35.948889+0000","last_peered":"2026-02-24T16:10:35.948889+0000","last_clean":"2026-02-24T16:09:04.462486+0000","last_became_active":"2026-02-24T16:10:35.930577+0000","last_became_peered":"2026-02-24T16:10:35.930577+0000","last_unstale":"2026-02-24T16:10:35.948889+0000","last_undegraded":"2026-02-24T16:10:35.948889+0000","last_fullsized":"2026-02-24T16:10:35.948889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.941372+0000","last_change":"2026-02-24T16:10:35.942062+0000","last_active":"2026-02-24T16:10:35.941372+0000","last_peered":"2026-02-24T16:10:35.941372+0000","last_clean":"2026-02-24T16:09:13.497663+0000","last_became_active":"2026-02-24T16:10:35.924577+0000","last_became_peered":"2026-02-24T16:10:35.924577+0000","last_unstale":"2026-02-24T16:10:35.941372+0000","last_undegraded":"2026-02-24T16:10:35.941372+0000","last_fullsized":"2026-02-24T16:10:35.941372+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.943579+0000","last_change":"2026-02-24T16:10:35.944152+0000","last_active":"2026-02-24T16:10:35.943579+0000","last_peered":"2026-02-24T16:10:35.943579+0000","last_clean":"2026-02-24T16:09:04.447967+0000","last_became_active":"2026-02-24T16:10:35.926938+0000","last_became_peered":"2026-02-24T16:10:35.926938+0000","last_unstale":"2026-02-24T16:10:35.943579+0000","last_undegraded":"2026-02-24T16:10:35.943579+0000","last_fullsized":"2026-02-24T16:10:35.943579+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898272+0000","last_change":"2026-02-24T16:10:29.910183+0000","last_active":"2026-02-24T16:10:35.898272+0000","last_peered":"2026-02-24T16:10:35.898272+0000","last_clean":"2026-02-24T16:10:35.898272+0000","last_became_active":"2026-02-24T16:10:29.905441+0000","last_became_peered":"2026-02-24T16:10:29.905441+0000","last_unstale":"2026-02-24T16:10:35.898272+0000","last_undegraded":"2026-02-24T16:10:35.898272+0000","last_fullsized":"2026-02-24T16:10:35.898272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.955825+0000","last_change":"2026-02-24T16:10:35.956402+0000","last_active":"2026-02-24T16:10:35.955825+0000","last_peered":"2026-02-24T16:10:35.955825+0000","last_clean":"2026-02-24T16:09:04.453931+0000","last_became_active":"2026-02-24T16:10:35.941819+0000","last_became_peered":"2026-02-24T16:10:35.941819+0000","last_unstale":"2026-02-24T16:10:35.955825+0000","last_undegraded":"2026-02-24T16:10:35.955825+0000","last_fullsized":"2026-02-24T16:10:35.955825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898989+0000","last_change":"2026-02-24T16:10:29.909023+0000","last_active":"2026-02-24T16:10:35.898989+0000","last_peered":"2026-02-24T16:10:35.898989+0000","last_clean":"2026-02-24T16:10:35.898989+0000","last_became_active":"2026-02-24T16:10:29.904319+0000","last_became_peered":"2026-02-24T16:10:29.904319+0000","last_unstale":"2026-02-24T16:10:35.898989+0000","last_undegraded":"2026-02-24T16:10:35.898989+0000","last_fullsized":"2026-02-24T16:10:35.898989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.939552+0000","last_change":"2026-02-24T16:10:35.939893+0000","last_active":"2026-02-24T16:10:35.939552+0000","last_peered":"2026-02-24T16:10:35.939552+0000","last_clean":"2026-02-24T16:09:06.422842+0000","last_became_active":"2026-02-24T16:10:35.925533+0000","last_became_peered":"2026-02-24T16:10:35.925533+0000","last_unstale":"2026-02-24T16:10:35.939552+0000","last_undegraded":"2026-02-24T16:10:35.939552+0000","last_fullsized":"2026-02-24T16:10:35.939552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.896486+0000","last_change":"2026-02-24T16:10:29.910363+0000","last_active":"2026-02-24T16:10:35.896486+0000","last_peered":"2026-02-24T16:10:35.896486+0000","last_clean":"2026-02-24T16:10:35.896486+0000","last_became_active":"2026-02-24T16:10:29.901363+0000","last_became_peered":"2026-02-24T16:10:29.901363+0000","last_unstale":"2026-02-24T16:10:35.896486+0000","last_undegraded":"2026-02-24T16:10:35.896486+0000","last_fullsized":"2026-02-24T16:10:35.896486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.952734+0000","last_change":"2026-02-24T16:10:35.952734+0000","last_active":"2026-02-24T16:10:35.952734+0000","last_peered":"2026-02-24T16:10:35.952734+0000","last_clean":"2026-02-24T16:10:35.952734+0000","last_became_active":"2026-02-24T16:10:35.947804+0000","last_became_peered":"2026-02-24T16:10:35.947804+0000","last_unstale":"2026-02-24T16:10:35.952734+0000","last_undegraded":"2026-02-24T16:10:35.952734+0000","last_fullsized":"2026-02-24T16:10:35.952734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898599+0000","last_change":"2026-02-24T16:10:26.872935+0000","last_active":"2026-02-24T16:10:35.898599+0000","last_peered":"2026-02-24T16:10:35.898599+0000","last_clean":"2026-02-24T16:10:35.898599+0000","last_became_active":"2026-02-24T16:10:23.890545+0000","last_became_peered":"2026-02-24T16:10:23.890545+0000","last_unstale":"2026-02-24T16:10:35.898599+0000","last_undegraded":"2026-02-24T16:10:35.898599+0000","last_fullsized":"2026-02-24T16:10:35.898599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:39.970803+0000","last_change":"2026-02-24T16:10:29.910589+0000","last_active":"2026-02-24T16:10:39.970803+0000","last_peered":"2026-02-24T16:10:39.970803+0000","last_clean":"2026-02-24T16:10:39.970803+0000","last_became_active":"2026-02-24T16:10:29.900921+0000","last_became_peered":"2026-02-24T16:10:29.900921+0000","last_unstale":"2026-02-24T16:10:39.970803+0000","last_undegraded":"2026-02-24T16:10:39.970803+0000","last_fullsized":"2026-02-24T16:10:39.970803+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":626,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.942166+0000","last_change":"2026-02-24T16:10:35.942497+0000","last_active":"2026-02-24T16:10:35.942166+0000","last_peered":"2026-02-24T16:10:35.942166+0000","last_clean":"2026-02-24T16:09:04.451125+0000","last_became_active":"2026-02-24T16:10:35.927513+0000","last_became_peered":"2026-02-24T16:10:35.927513+0000","last_unstale":"2026-02-24T16:10:35.942166+0000","last_undegraded":"2026-02-24T16:10:35.942166+0000","last_fullsized":"2026-02-24T16:10:35.942166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.944330+0000","last_change":"2026-02-24T16:10:35.944770+0000","last_active":"2026-02-24T16:10:35.944330+0000","last_peered":"2026-02-24T16:10:35.944330+0000","last_clean":"2026-02-24T16:09:12.473911+0000","last_became_active":"2026-02-24T16:10:35.932060+0000","last_became_peered":"2026-02-24T16:10:35.932060+0000","last_unstale":"2026-02-24T16:10:35.944330+0000","last_undegraded":"2026-02-24T16:10:35.944330+0000","last_fullsized":"2026-02-24T16:10:35.944330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898533+0000","last_change":"2026-02-24T16:10:26.873129+0000","last_active":"2026-02-24T16:10:35.898533+0000","last_peered":"2026-02-24T16:10:35.898533+0000","last_clean":"2026-02-24T16:10:35.898533+0000","last_became_active":"2026-02-24T16:10:23.884785+0000","last_became_peered":"2026-02-24T16:10:23.884785+0000","last_unstale":"2026-02-24T16:10:35.898533+0000","last_undegraded":"2026-02-24T16:10:35.898533+0000","last_fullsized":"2026-02-24T16:10:35.898533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.898780+0000","last_change":"2026-02-24T16:10:23.889332+0000","last_active":"2026-02-24T16:10:35.898780+0000","last_peered":"2026-02-24T16:10:35.898780+0000","last_clean":"2026-02-24T16:10:35.898780+0000","last_became_active":"2026-02-24T16:10:23.882812+0000","last_became_peered":"2026-02-24T16:10:23.882812+0000","last_unstale":"2026-02-24T16:10:35.898780+0000","last_undegraded":"2026-02-24T16:10:35.898780+0000","last_fullsized":"2026-02-24T16:10:35.898780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:11.414003+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:35.940902+0000","last_change":"2026-02-24T16:10:35.941600+0000","last_active":"2026-02-24T16:10:35.940902+0000","last_peered":"2026-02-24T16:10:35.940902+0000","last_clean":"2026-02-24T16:09:04.472771+0000","last_became_active":"2026-02-24T16:10:35.927161+0000","last_became_peered":"2026-02-24T16:10:35.927161+0000","last_unstale":"2026-02-24T16:10:35.940902+0000","last_undegraded":"2026-02-24T16:10:35.940902+0000","last_fullsized":"2026-02-24T16:10:35.940902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:09:03.391726+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1252,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":37,"seq":158913789956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":33,"seq":141733920782,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051602,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182423,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1732,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295996,"statfs":{"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T16:10:43.904 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-24T16:09:01.383612+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.904 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-24T16:09:03.391726+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.904 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2026-02-24T16:09:11.414003+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=11, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.905 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-24T16:09:03.391726+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.905 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2026-02-24T16:09:11.414003+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=11, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.905 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-24T16:09:03.391726+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.905 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2026-02-24T16:09:11.414003+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=11, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.905 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-24T16:09:03.391726+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.905 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2026-02-24T16:09:11.414003+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=11, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.905 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2026-02-24T16:09:11.414003+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=11, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.906 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-24T16:09:03.391726+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.906 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2026-02-24T16:09:11.414003+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=11, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.906 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-24T16:09:03.391726+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.906 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2026-02-24T16:09:11.414003+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=11, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.906 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-24T16:09:03.391726+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.906 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2026-02-24T16:09:11.414003+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=11, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.906 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-24T16:09:03.391726+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=9, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=16, tm_min=10, tm_sec=41, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T16:10:43.907 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-24T16:11:03.907 DEBUG:teuthology.orchestra.run.trial053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T16:11:03.987 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:11:03.982+0000 7f329a646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:11:03.989 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:11:03.987+0000 7f329a646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:11:04.103 INFO:teuthology.orchestra.run.trial053.stdout: 2026-02-24T16:11:04.104 INFO:teuthology.orchestra.run.trial053.stderr:dumped all 2026-02-24T16:11:04.112 INFO:teuthology.orchestra.run.trial053.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2026-02-24T16:11:03.063782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2190387,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":1611,"num_write":110,"num_write_kb":2683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209190912,"kb_used":7960,"kb_used_data":7960,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":209182952,"statfs":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001787"},"pg_stats":[{"pgid":"1.0","version":"13'52","reported_seq":109,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.094943+0000","last_change":"2026-02-24T16:10:43.132385+0000","last_active":"2026-02-24T16:10:43.094943+0000","last_peered":"2026-02-24T16:10:43.094943+0000","last_clean":"2026-02-24T16:10:43.094943+0000","last_became_active":"2026-02-24T16:10:23.882064+0000","last_became_peered":"2026-02-24T16:10:23.882064+0000","last_unstale":"2026-02-24T16:10:43.094943+0000","last_undegraded":"2026-02-24T16:10:43.094943+0000","last_fullsized":"2026-02-24T16:10:43.094943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'52","last_scrub_stamp":"2026-02-24T16:10:43.132328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.132328+0000","last_clean_scrub_stamp":"2026-02-24T16:09:01.383612+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.694505+0000","last_change":"2026-02-24T16:10:43.721441+0000","last_active":"2026-02-24T16:10:43.694505+0000","last_peered":"2026-02-24T16:10:43.694505+0000","last_clean":"2026-02-24T16:10:43.694505+0000","last_became_active":"2026-02-24T16:10:35.930577+0000","last_became_peered":"2026-02-24T16:10:35.930577+0000","last_unstale":"2026-02-24T16:10:43.694505+0000","last_undegraded":"2026-02-24T16:10:43.694505+0000","last_fullsized":"2026-02-24T16:10:43.694505+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2026-02-24T16:10:43.721372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.721372+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'6","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.695990+0000","last_change":"2026-02-24T16:10:43.723107+0000","last_active":"2026-02-24T16:10:43.695990+0000","last_peered":"2026-02-24T16:10:43.695990+0000","last_clean":"2026-02-24T16:10:43.695990+0000","last_became_active":"2026-02-24T16:10:35.924577+0000","last_became_peered":"2026-02-24T16:10:35.924577+0000","last_unstale":"2026-02-24T16:10:43.695990+0000","last_undegraded":"2026-02-24T16:10:43.695990+0000","last_fullsized":"2026-02-24T16:10:43.695990+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2026-02-24T16:10:43.723047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.723047+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":6,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.693174+0000","last_change":"2026-02-24T16:10:43.712332+0000","last_active":"2026-02-24T16:10:43.693174+0000","last_peered":"2026-02-24T16:10:43.693174+0000","last_clean":"2026-02-24T16:10:43.693174+0000","last_became_active":"2026-02-24T16:10:35.926938+0000","last_became_peered":"2026-02-24T16:10:35.926938+0000","last_unstale":"2026-02-24T16:10:43.693174+0000","last_undegraded":"2026-02-24T16:10:43.693174+0000","last_fullsized":"2026-02-24T16:10:43.693174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:43.712278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.712278+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:42.795055+0000","last_change":"2026-02-24T16:10:42.804571+0000","last_active":"2026-02-24T16:10:42.795055+0000","last_peered":"2026-02-24T16:10:42.795055+0000","last_clean":"2026-02-24T16:10:42.795055+0000","last_became_active":"2026-02-24T16:10:29.905441+0000","last_became_peered":"2026-02-24T16:10:29.905441+0000","last_unstale":"2026-02-24T16:10:42.795055+0000","last_undegraded":"2026-02-24T16:10:42.795055+0000","last_fullsized":"2026-02-24T16:10:42.795055+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:42.804485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:42.804485+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.391843+0000","last_change":"2026-02-24T16:10:43.400630+0000","last_active":"2026-02-24T16:10:43.391843+0000","last_peered":"2026-02-24T16:10:43.391843+0000","last_clean":"2026-02-24T16:10:43.391843+0000","last_became_active":"2026-02-24T16:10:35.941819+0000","last_became_peered":"2026-02-24T16:10:35.941819+0000","last_unstale":"2026-02-24T16:10:43.391843+0000","last_undegraded":"2026-02-24T16:10:43.391843+0000","last_fullsized":"2026-02-24T16:10:43.391843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:43.400557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.400557+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.097264+0000","last_change":"2026-02-24T16:10:43.106474+0000","last_active":"2026-02-24T16:10:43.097264+0000","last_peered":"2026-02-24T16:10:43.097264+0000","last_clean":"2026-02-24T16:10:43.097264+0000","last_became_active":"2026-02-24T16:10:29.904319+0000","last_became_peered":"2026-02-24T16:10:29.904319+0000","last_unstale":"2026-02-24T16:10:43.097264+0000","last_undegraded":"2026-02-24T16:10:43.097264+0000","last_fullsized":"2026-02-24T16:10:43.097264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:43.106413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.106413+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.693714+0000","last_change":"2026-02-24T16:10:43.712838+0000","last_active":"2026-02-24T16:10:43.693714+0000","last_peered":"2026-02-24T16:10:43.693714+0000","last_clean":"2026-02-24T16:10:43.693714+0000","last_became_active":"2026-02-24T16:10:35.925533+0000","last_became_peered":"2026-02-24T16:10:35.925533+0000","last_unstale":"2026-02-24T16:10:43.693714+0000","last_undegraded":"2026-02-24T16:10:43.693714+0000","last_fullsized":"2026-02-24T16:10:43.693714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'2","last_scrub_stamp":"2026-02-24T16:10:43.712772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.712772+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:42.795011+0000","last_change":"2026-02-24T16:10:42.803023+0000","last_active":"2026-02-24T16:10:42.795011+0000","last_peered":"2026-02-24T16:10:42.795011+0000","last_clean":"2026-02-24T16:10:42.795011+0000","last_became_active":"2026-02-24T16:10:29.901363+0000","last_became_peered":"2026-02-24T16:10:29.901363+0000","last_unstale":"2026-02-24T16:10:42.795011+0000","last_undegraded":"2026-02-24T16:10:42.795011+0000","last_fullsized":"2026-02-24T16:10:42.795011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:42.802906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:42.802906+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"22'10","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.392465+0000","last_change":"2026-02-24T16:10:43.406984+0000","last_active":"2026-02-24T16:10:43.392465+0000","last_peered":"2026-02-24T16:10:43.392465+0000","last_clean":"2026-02-24T16:10:43.392465+0000","last_became_active":"2026-02-24T16:10:35.947804+0000","last_became_peered":"2026-02-24T16:10:35.947804+0000","last_unstale":"2026-02-24T16:10:43.392465+0000","last_undegraded":"2026-02-24T16:10:43.392465+0000","last_fullsized":"2026-02-24T16:10:43.392465+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'10","last_scrub_stamp":"2026-02-24T16:10:43.406889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.406889+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":10,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.095980+0000","last_change":"2026-02-24T16:10:43.106425+0000","last_active":"2026-02-24T16:10:43.095980+0000","last_peered":"2026-02-24T16:10:43.095980+0000","last_clean":"2026-02-24T16:10:43.095980+0000","last_became_active":"2026-02-24T16:10:23.890545+0000","last_became_peered":"2026-02-24T16:10:23.890545+0000","last_unstale":"2026-02-24T16:10:43.095980+0000","last_undegraded":"2026-02-24T16:10:43.095980+0000","last_fullsized":"2026-02-24T16:10:43.095980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:43.106349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.106349+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"21'5","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.096747+0000","last_change":"2026-02-24T16:10:43.125891+0000","last_active":"2026-02-24T16:10:43.096747+0000","last_peered":"2026-02-24T16:10:43.096747+0000","last_clean":"2026-02-24T16:10:43.096747+0000","last_became_active":"2026-02-24T16:10:29.900921+0000","last_became_peered":"2026-02-24T16:10:29.900921+0000","last_unstale":"2026-02-24T16:10:43.096747+0000","last_undegraded":"2026-02-24T16:10:43.096747+0000","last_fullsized":"2026-02-24T16:10:43.096747+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"21'5","last_scrub_stamp":"2026-02-24T16:10:43.125826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.125826+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":640000,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":626,"num_write":5,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.695722+0000","last_change":"2026-02-24T16:10:43.712138+0000","last_active":"2026-02-24T16:10:43.695722+0000","last_peered":"2026-02-24T16:10:43.695722+0000","last_clean":"2026-02-24T16:10:43.695722+0000","last_became_active":"2026-02-24T16:10:35.927513+0000","last_became_peered":"2026-02-24T16:10:35.927513+0000","last_unstale":"2026-02-24T16:10:43.695722+0000","last_undegraded":"2026-02-24T16:10:43.695722+0000","last_fullsized":"2026-02-24T16:10:43.695722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:43.712082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.712082+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.697368+0000","last_change":"2026-02-24T16:10:43.710493+0000","last_active":"2026-02-24T16:10:43.697368+0000","last_peered":"2026-02-24T16:10:43.697368+0000","last_clean":"2026-02-24T16:10:43.697368+0000","last_became_active":"2026-02-24T16:10:35.932060+0000","last_became_peered":"2026-02-24T16:10:35.932060+0000","last_unstale":"2026-02-24T16:10:43.697368+0000","last_undegraded":"2026-02-24T16:10:43.697368+0000","last_fullsized":"2026-02-24T16:10:43.697368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:43.710396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.710396+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.096620+0000","last_change":"2026-02-24T16:10:43.107487+0000","last_active":"2026-02-24T16:10:43.096620+0000","last_peered":"2026-02-24T16:10:43.096620+0000","last_clean":"2026-02-24T16:10:43.096620+0000","last_became_active":"2026-02-24T16:10:23.884785+0000","last_became_peered":"2026-02-24T16:10:23.884785+0000","last_unstale":"2026-02-24T16:10:43.096620+0000","last_undegraded":"2026-02-24T16:10:43.096620+0000","last_fullsized":"2026-02-24T16:10:43.096620+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:43.107400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.107400+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"22'8","reported_seq":58,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:42.795697+0000","last_change":"2026-02-24T16:10:42.808575+0000","last_active":"2026-02-24T16:10:42.795697+0000","last_peered":"2026-02-24T16:10:42.795697+0000","last_clean":"2026-02-24T16:10:42.795697+0000","last_became_active":"2026-02-24T16:10:23.882812+0000","last_became_peered":"2026-02-24T16:10:23.882812+0000","last_unstale":"2026-02-24T16:10:42.795697+0000","last_undegraded":"2026-02-24T16:10:42.795697+0000","last_fullsized":"2026-02-24T16:10:42.795697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'8","last_scrub_stamp":"2026-02-24T16:10:42.808492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:42.808492+0000","last_clean_scrub_stamp":"2026-02-24T16:09:11.414003+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320000,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":313,"num_write":8,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2026-02-24T16:10:43.695559+0000","last_change":"2026-02-24T16:10:43.706084+0000","last_active":"2026-02-24T16:10:43.695559+0000","last_peered":"2026-02-24T16:10:43.695559+0000","last_clean":"2026-02-24T16:10:43.695559+0000","last_became_active":"2026-02-24T16:10:35.927161+0000","last_became_peered":"2026-02-24T16:10:35.927161+0000","last_unstale":"2026-02-24T16:10:43.695559+0000","last_undegraded":"2026-02-24T16:10:43.695559+0000","last_fullsized":"2026-02-24T16:10:43.695559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T16:10:43.706005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T16:10:43.706005+0000","last_clean_scrub_stamp":"2026-02-24T16:09:03.391726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":1600000,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1565,"num_write":29,"num_write_kb":1575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214211493888,"available":214203342848,"internally_reserved":0,"allocated":8151040,"data_stored":8151040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29,"ondisk_log_size":29,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":160658620416,"available":160652242944,"internally_reserved":0,"allocated":6377472,"data_stored":6377472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":37,"seq":158913789976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1488,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52296240,"statfs":{"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":33,"seq":141733920801,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2228,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295500,"statfs":{"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":29,"seq":124554051622,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":2512,"kb_used_data":2512,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295216,"statfs":{"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":25,"seq":107374182443,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52297728,"kb_used":1732,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":52295996,"statfs":{"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53552873472,"available":53551099904,"internally_reserved":0,"allocated":1773568,"data_stored":1773568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53552873472,"available":53550301184,"internally_reserved":0,"allocated":2572288,"data_stored":2572288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53552873472,"available":53550592000,"internally_reserved":0,"allocated":2281472,"data_stored":2281472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53552873472,"available":53551349760,"internally_reserved":0,"allocated":1523712,"data_stored":1523712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T16:11:04.115 DEBUG:teuthology.orchestra.run.trial053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-24T16:11:04.190 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:11:04.184+0000 7f0e37e35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:11:04.193 INFO:teuthology.orchestra.run.trial053.stderr:2026-02-24T16:11:04.191+0000 7f0e37e35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-24T16:11:04.319 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-24T16:11:04.319 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-24T16:11:04.319 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-24T16:11:04.319 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:11:04.383 INFO:tasks.ceph.osd.0:Stopped 2026-02-24T16:11:04.383 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-24T16:11:04.384 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:11:04.451 INFO:tasks.ceph.osd.1:Stopped 2026-02-24T16:11:04.451 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-24T16:11:04.451 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:11:04.512 INFO:tasks.ceph.osd.2:Stopped 2026-02-24T16:11:04.512 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-24T16:11:04.512 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:11:04.577 INFO:tasks.ceph.osd.3:Stopped 2026-02-24T16:11:04.578 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-24T16:11:04.578 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-24T16:11:04.578 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:11:04.610 INFO:tasks.ceph.mgr.x:Stopped 2026-02-24T16:11:04.610 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-24T16:11:04.611 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-24T16:11:04.611 INFO:teuthology.orchestra.run:waiting for 300 2026-02-24T16:11:04.660 INFO:tasks.ceph.mon.a:Stopped 2026-02-24T16:11:04.660 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-24T16:11:04.661 DEBUG:teuthology.orchestra.run.trial053:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(OBJECT_' | grep -E -v 'for optimal performance' | head -n 1 2026-02-24T16:11:04.727 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:11:04.727 DEBUG:teuthology.orchestra.run.trial053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-24T16:11:04.800 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:11:04.801 DEBUG:teuthology.orchestra.run.trial053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-24T16:11:04.870 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:11:04.870 DEBUG:teuthology.orchestra.run.trial053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-24T16:11:04.939 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:11:04.939 DEBUG:teuthology.orchestra.run.trial053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-24T16:11:05.013 INFO:tasks.ceph:Archiving mon data... 2026-02-24T16:11:05.016 DEBUG:teuthology.misc:Transferring archived files from trial053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial/68165/data/mon.a.tgz 2026-02-24T16:11:05.016 DEBUG:teuthology.orchestra.run.trial053:> mktemp 2026-02-24T16:11:05.069 INFO:teuthology.orchestra.run.trial053.stdout:/tmp/tmp.ZXihebRJcn 2026-02-24T16:11:05.070 DEBUG:teuthology.orchestra.run.trial053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZXihebRJcn 2026-02-24T16:11:05.159 DEBUG:teuthology.orchestra.run.trial053:> sudo chmod 0666 /tmp/tmp.ZXihebRJcn 2026-02-24T16:11:05.240 DEBUG:teuthology.orchestra.remote:trial053:/tmp/tmp.ZXihebRJcn is 201KB 2026-02-24T16:11:05.293 DEBUG:teuthology.orchestra.run.trial053:> rm -fr /tmp/tmp.ZXihebRJcn 2026-02-24T16:11:05.309 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-24T16:11:05.309 DEBUG:teuthology.orchestra.run.trial053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T16:11:05.428 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T16:11:05.429 INFO:tasks.ceph:Archiving crash dumps... 2026-02-24T16:11:05.431 DEBUG:teuthology.misc:Transferring archived files from trial053:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial/68165/remote/trial053/crash 2026-02-24T16:11:05.432 DEBUG:teuthology.orchestra.run.trial053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T16:11:05.491 INFO:tasks.ceph:Compressing logs... 2026-02-24T16:11:05.492 DEBUG:teuthology.orchestra.run.trial053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T16:11:05.556 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-24T16:11:05.588 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46599.log 2026-02-24T16:11:05.588 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41876.log 2026-02-24T16:11:05.588 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46599.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-24T16:11:05.588 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46599.log.gz 2026-02-24T16:11:05.588 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42581.log 2026-02-24T16:11:05.588 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41876.log.gz 2026-02-24T16:11:05.588 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43910.log 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42581.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42581.log.gz 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42532.log 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38952.log 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43910.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43910.log.gz 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45609.log 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.42532.log.gz 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph.tmp-client.admin.38952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42189.log 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38952.log.gz 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.45609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43479.log 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.45609.log.gz 2026-02-24T16:11:05.589 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44168.log 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42189.log.gz 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42238.log 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.43479.log.gz 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.44168.log: 66.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.44168.log.gz -5 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr: --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42238.log.gz 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40917.log 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.44039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42434.log 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.40917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41878.log 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40917.log.gz 2026-02-24T16:11:05.590 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43608.log 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42434.log.gz 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41878.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41878.log.gz 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43737.log 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43608.log.gz 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42385.log 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr: 66.9% -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43737.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43737.log.gz 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40607.log 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40816.log 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42385.log.gz 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41441.log 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.40607.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40607.log.gz 2026-02-24T16:11:05.591 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.40816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41347.log 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40816.log.gz 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41441.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41441.log.gz 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45810.log 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log/var/log/ceph/ceph-client.admin.41347.log: 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41347.log.gz 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.45810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46001.log 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.45810.log.gz 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.45903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41601.log 50.0% 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42706.log 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46001.log.gz 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46148.log 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41601.log.gz 2026-02-24T16:11:05.592 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41699.log 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42706.log.gz 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45157.log 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46148.log.gz 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43867.log 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41699.log.gz 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.45157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43694.log 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45157.log.gz 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46442.log 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43867.log.gz 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42655.log 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.43694.log.gz 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46295.log 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46442.log.gz 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41875.log 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42655.log.gz 2026-02-24T16:11:05.593 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46295.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46295.log.gz 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46344.log 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41875.log.gz 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:gzip/var/log/ceph/ceph-client.admin.45743.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43392.log 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46246.log 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46344.log.gz 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43090.log 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43392.log.gz 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40560.log 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46246.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46246.log.gz 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43003.log 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43090.log: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.43090.log.gz 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.40560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41650.log 2026-02-24T16:11:05.594 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40560.log.gz 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44125.log 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43003.log.gz 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44082.log 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41650.log.gz 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46050.log 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.44125.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.44125.log.gz 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.44082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41262.log 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.44082.log.gz 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46050.log.gz 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40769.log 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41262.log.gz 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42959.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2026-02-24T16:11:05.595 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.40769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44286.log 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40769.log.gz 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43522.log 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.44286.log: gzip -5 87.2% --verbose -- replaced with /var/log/ceph/ceph.audit.log.gz -- 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr: /var/log/ceph/ceph-client.admin.45676.log 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44286.log.gz 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42074.log 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr: 65.9% -- replaced with /var/log/ceph/ceph-client.admin.43522.log.gz 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.45676.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.45676.log.gz 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42071.log 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42074.log.gz 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43176.log 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43824.log 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42071.log.gz 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41748.log 2026-02-24T16:11:05.596 INFO:teuthology.orchestra.run.trial053.stderr: 65.6% -- replaced with /var/log/ceph/ceph-client.admin.43176.log.gz 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43996.log 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43824.log.gz 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44237.log 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41748.log.gz 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43996.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43996.log.gz 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46099.log 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.44237.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44237.log.gz 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41877.log 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46099.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46099.log.gz 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43133.log 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43220.log 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41877.log.gz 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40863.log 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43133.log.gz 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46197.log 2026-02-24T16:11:05.597 INFO:teuthology.orchestra.run.trial053.stderr: 65.6% -- replaced with /var/log/ceph/ceph-client.admin.43220.log.gz 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.40863.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40863.log.gz 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43651.log 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46197.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46197.log.gz 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40464.log 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.43651.log.gz 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43565.log 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.40464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42073.log 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40464.log.gz 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43565.log: gzip 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43565.log.gz 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43349.log 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42073.log: gzip -5 50.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.42073.log.gz 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr: -- /var/log/ceph/ceph-client.admin.41511.log 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr: 66.1% -- replaced with /var/log/ceph/ceph-client.admin.43349.log.gz 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41511.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T16:11:05.598 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41511.log.gz 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43047.log 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gz 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46393.log 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43047.log: 84.6% -- replaced with /var/log/ceph/ceph.log.gzgzip 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42336.log 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43047.log.gz 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46393.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46393.log.gz 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43953.log 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42336.log.gz 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43953.log.gz 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.45952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42072.log 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46552.log 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45542.log 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42072.log.gz 2026-02-24T16:11:05.599 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41293.log 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46552.log.gz 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.45542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46491.log 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.45542.log.gz 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.41293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43263.log 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41293.log.gz 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.46491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43435.log 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46491.log.gz 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42483.log 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43263.log.gz 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.43435.log: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.43435.log.gz 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr:/var/log/ceph/ceph-client.admin.42483.log: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.42483.log.gz 2026-02-24T16:11:05.600 INFO:teuthology.orchestra.run.trial053.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-24T16:11:05.603 INFO:teuthology.orchestra.run.trial053.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-24T16:11:05.939 INFO:teuthology.orchestra.run.trial053.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-24T16:11:06.015 INFO:teuthology.orchestra.run.trial053.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-24T16:11:06.333 INFO:teuthology.orchestra.run.trial053.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-24T16:11:06.371 INFO:teuthology.orchestra.run.trial053.stderr: 95.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-24T16:11:06.373 INFO:teuthology.orchestra.run.trial053.stderr: 2026-02-24T16:11:06.373 INFO:teuthology.orchestra.run.trial053.stderr:real 0m0.825s 2026-02-24T16:11:06.373 INFO:teuthology.orchestra.run.trial053.stderr:user 0m2.348s 2026-02-24T16:11:06.373 INFO:teuthology.orchestra.run.trial053.stderr:sys 0m0.190s 2026-02-24T16:11:06.374 INFO:tasks.ceph:Archiving logs... 2026-02-24T16:11:06.374 DEBUG:teuthology.misc:Transferring archived files from trial053:/var/log/ceph to /home/teuthworker/mnt/teuthology/liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial/68165/remote/trial053/log 2026-02-24T16:11:06.376 DEBUG:teuthology.orchestra.run.trial053:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T16:11:06.875 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T16:11:06.942 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T16:11:06.953 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T16:11:06.953 DEBUG:teuthology.orchestra.run.trial053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T16:11:06.979 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T16:11:06.990 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T16:11:06.990 DEBUG:teuthology.orchestra.run.trial053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T16:11:07.034 INFO:teuthology.orchestra.run.trial053.stderr:bash: line 1: ntpq: command not found 2026-02-24T16:11:07.071 INFO:teuthology.orchestra.run.trial053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T16:11:07.071 INFO:teuthology.orchestra.run.trial053.stdout:=============================================================================== 2026-02-24T16:11:07.071 INFO:teuthology.orchestra.run.trial053.stdout:^+ ntp.maxhost.io 2 7 377 87 +312us[ +312us] +/- 56ms 2026-02-24T16:11:07.072 INFO:teuthology.orchestra.run.trial053.stdout:^- 159.89.45.132 2 7 377 82 -240us[ -240us] +/- 30ms 2026-02-24T16:11:07.072 INFO:teuthology.orchestra.run.trial053.stdout:^+ arm1.maxhost.io 2 8 363 217 -648us[ -618us] +/- 54ms 2026-02-24T16:11:07.072 INFO:teuthology.orchestra.run.trial053.stdout:^* 144.202.62.209.vultruser> 3 8 377 156 +245us[ +281us] +/- 21ms 2026-02-24T16:11:07.072 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T16:11:07.084 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T16:11:07.084 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T16:11:07.100 DEBUG:teuthology.orchestra.run.trial053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T16:11:07.168 DEBUG:teuthology.orchestra.run.trial053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T16:11:07.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T16:11:07.194 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T16:11:07.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T16:11:07.226 INFO:teuthology.task.internal:Duration was 2063.102817 seconds 2026-02-24T16:11:07.226 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T16:11:07.242 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T16:11:07.242 DEBUG:teuthology.orchestra.run.trial053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T16:11:07.279 INFO:teuthology.orchestra.run.trial053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T16:11:07.563 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T16:11:07.564 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial053.front.sepia.ceph.com 2026-02-24T16:11:07.564 DEBUG:teuthology.orchestra.run.trial053:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T16:11:07.622 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T16:11:07.623 DEBUG:teuthology.orchestra.run.trial053:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T16:11:07.726 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T16:11:07.726 DEBUG:teuthology.orchestra.run.trial053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T16:11:07.750 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T16:11:07.752 INFO:teuthology.orchestra.run.trial053.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T16:11:07.752 INFO:teuthology.orchestra.run.trial053.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T16:11:07.752 INFO:teuthology.orchestra.run.trial053.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T16:11:07.752 INFO:teuthology.orchestra.run.trial053.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T16:11:07.762 INFO:teuthology.orchestra.run.trial053.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T16:11:07.764 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T16:11:07.781 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T16:11:07.781 DEBUG:teuthology.orchestra.run.trial053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T16:11:07.827 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T16:11:07.844 DEBUG:teuthology.orchestra.run.trial053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T16:11:07.891 INFO:teuthology.orchestra.run.trial053.stdout:kernel.core_pattern = core 2026-02-24T16:11:07.905 DEBUG:teuthology.orchestra.run.trial053:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T16:11:07.961 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T16:11:07.962 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T16:11:07.979 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T16:11:07.980 DEBUG:teuthology.misc:Transferring archived files from trial053:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/liucm-2026-02-24_15:28:57-crimson-rados-wip-liucm-shard-redesign-crimson-only-distro-debug-trial/68165/remote/trial053 2026-02-24T16:11:07.980 DEBUG:teuthology.orchestra.run.trial053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T16:11:08.039 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T16:11:08.039 DEBUG:teuthology.orchestra.run.trial053:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T16:11:08.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T16:11:08.103 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T16:11:08.103 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T16:11:08.123 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T16:11:08.123 DEBUG:teuthology.orchestra.run.trial053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T16:11:08.141 INFO:teuthology.orchestra.run.trial053.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 16:11 /home/ubuntu/cephtest 2026-02-24T16:11:08.142 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T16:11:08.160 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T16:11:08.198 INFO:teuthology.run:Summary data: description: crimson-rados/objectstore_tool/{0-crimson_install clusters/fixed-1-num-threads-3 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/seastore-segmented tasks/crimson_obejctstore_tool} duration: 2063.1028168201447 flavor: debug owner: scheduled_liucm@soko04.front.sepia.ceph.com success: true 2026-02-24T16:11:08.198 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T16:11:08.327 INFO:teuthology.run:pass